Jul 21 02:00:02 devstack cinder-volume[76370]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 21 02:00:02 devstack cinder-volume[76370]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 21 02:00:02 devstack cinder-volume[76370]: we strongly recommend against using it for new projects. Jul 21 02:00:02 devstack cinder-volume[76370]: If you are already using Eventlet, we recommend migrating to a different Jul 21 02:00:02 devstack cinder-volume[76370]: framework. For more detail see Jul 21 02:00:02 devstack cinder-volume[76370]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 21 02:00:02 devstack cinder-volume[76370]: import eventlet # noqa Jul 21 02:00:04 devstack cinder-volume[76370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76370) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 02:00:04 devstack cinder-volume[76370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76370) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 02:00:04 devstack cinder-volume[76370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76370) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 02:00:05 devstack cinder-volume[76370]: INFO dbcounter [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] Registered counter for database cinder Jul 21 02:00:05 devstack cinder-volume[76370]: DEBUG oslo_db.sqlalchemy.engines [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76370) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 02:00:06 devstack cinder-volume[76370]: DEBUG dbcounter [-] [76370] Writer thread running {{(pid=76370) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 02:00:06 devstack cinder-volume[76370]: INFO cinder.rpc [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 21 02:00:06 devstack cinder-volume[76370]: INFO cinder.rpc [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 21 02:00:06 devstack cinder-volume[76370]: DEBUG oslo_db.sqlalchemy.engines [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76370) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 02:00:06 devstack cinder-volume[76370]: INFO cinder.volume.manager [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] Determined volume DB was empty at startup. Jul 21 02:00:06 devstack cinder-volume[76370]: DEBUG cinder.volume.manager [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76370) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 21 02:00:06 devstack cinder-volume[76370]: INFO cinder.volume.manager [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 21 02:00:06 devstack cinder-volume[76370]: WARNING stevedore.named [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 21 02:00:06 devstack cinder-volume[76370]: WARNING castellan.key_manager [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 02:00:06 devstack cinder-volume[76370]: WARNING cinder.keymgr.conf_key_mgr [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 02:00:06 devstack cinder-volume[76370]: DEBUG cinder.volume.drivers.lvm [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76370) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 21 02:00:06 devstack cinder-volume[76370]: DEBUG oslo_concurrency.processutils [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76370) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:00:06 devstack cinder-volume[76370]: DEBUG oslo_concurrency.processutils [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] CMD "cinder-rtstool verify" returned: 0 in 0.472s {{(pid=76370) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:00:06 devstack cinder-volume[76370]: DEBUG oslo_db.sqlalchemy.engines [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76370) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 02:00:06 devstack cinder-volume[76370]: INFO cinder.rpc [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 21 02:00:06 devstack cinder-volume[76370]: INFO cinder.rpc [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 21 02:00:06 devstack cinder-volume[76370]: WARNING stevedore.named [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 21 02:00:06 devstack cinder-volume[76370]: WARNING castellan.key_manager [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 02:00:06 devstack cinder-volume[76370]: INFO cinder.volume.manager [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_db.sqlalchemy.engines [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76370) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 02:00:07 devstack cinder-volume[76370]: INFO oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] Starting 1 workers Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] Started child 76517 {{(pid=76370) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] Full set of CONF: {{(pid=76370) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] ******************************************************************************** {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] Configuration options gathered from: {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 21 02:00:07 devstack cinder-volume[76517]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] ================================================================================ {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] allow_availability_zone_fallback = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] allow_compression_on_image_upload = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] allowed_direct_url_schemes = [] {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] api_rate_limit = True {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] auth_strategy = keystone {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] az_cache_duration = 3600 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_availability_zone = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_host = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_name = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_stats_polling_interval = 60 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backup_api_class = cinder.backup.api.API {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backup_name_template = backup-%s {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backup_use_same_host = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backup_use_temp_snapshot = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] chap_password = **** {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] chap_username = {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cinder_internal_tenant_project_id = be39213244aa4f9aaafdbaa630944738 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cinder_internal_tenant_user_id = a6c78acc4a5047548c4c5976a5ec5857 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cloned_volume_same_az = True {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cluster = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] compression_format = gzip {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] compute_api_class = cinder.compute.nova.API {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] config_dir = [] {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] config_source = [] {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] control_exchange = openstack {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] debug = True {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] default_availability_zone = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] default_group_type = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] default_volume_type = lvmdriver-1 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] disk_geometry = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] driver_client_cert = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] driver_client_cert_key = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] driver_data_namespace = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] driver_ssl_cert_path = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] driver_ssl_cert_verify = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] driver_use_ssl = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] enable_force_upload = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] enable_new_services = True {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] enable_unsupported_driver = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] enforce_multipath_for_image_xfer = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] filter_function = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] glance_api_insecure = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] glance_api_servers = ['http://192.168.122.80/image'] {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] glance_api_ssl_compression = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] glance_ca_certificates_file = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] glance_catalog_info = image:glance:publicURL {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] glance_certfile = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] glance_keyfile = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] glance_num_retries = 3 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] glance_request_timeout = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] goodness_function = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] graceful_shutdown_timeout = 5 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] group_api_class = cinder.group.api.API {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] host = devstack {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] image_compress_on_upload = True {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] image_conversion_address_space_limit = 1 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] image_conversion_cpu_limit = 60 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] image_conversion_disable = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] image_upload_use_cinder_backend = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] image_upload_use_internal_tenant = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] image_volume_cache_enabled = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] image_volume_cache_max_count = 0 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] image_volume_cache_max_size_gb = 0 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] init_host_max_objects_retrieval = 0 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] instance_format = [instance: %(uuid)s] {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] iscsi_target_flags = {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] iscsi_write_cache = on {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] iser_helper = tgtadm {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] iser_ip_address = 192.168.122.80 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] iser_port = 3260 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] log_color = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] log_config_append = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] log_dir = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] log_file = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] log_options = True {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] log_rotate_interval = 1 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] log_rotate_interval_type = days {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] log_rotation_type = none {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76517]: INFO cinder.volume.manager [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] max_age = 0 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] max_logfile_count = 30 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] max_logfile_size_mb = 200 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] max_over_subscription_ratio = 20.0 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] message_reap_interval = 86400 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] message_ttl = 2592000 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] migration_create_volume_timeout_secs = 300 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] monkey_patch = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] monkey_patch_modules = [] {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] my_ip = 192.168.122.80 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] no_snapshot_gb_quota = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] num_iser_scan_tries = 3 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] num_shell_tries = 3 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] num_volume_device_scan_tries = 3 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] nvmeof_conn_info_version = 1 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] nvmet_ns_id = 10 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] nvmet_port_id = 1 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] osapi_max_limit = 1000 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] osapi_volume_ext_list = [] {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] osapi_volume_listen_port = 8776 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] osapi_volume_use_ssl = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] osapi_volume_workers = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] per_volume_size_limit = -1 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] periodic_fuzzy_delay = 60 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] periodic_interval = 60 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] public_endpoint = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] publish_errors = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] quota_backup_gigabytes = 1000 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] quota_backups = 10 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] quota_gigabytes = 1000 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] quota_groups = 10 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] quota_snapshots = 10 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] quota_volumes = 10 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] rate_limit_burst = 0 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] rate_limit_except_level = CRITICAL {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] rate_limit_interval = 0 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] reinit_driver_count = 3 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] replication_device = **** {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] report_discard_supported = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] report_interval = 120 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] reservation_clean_interval = 86400 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] reservation_expire = 86400 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] reserved_image_namespaces = [] {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] reserved_percentage = 0 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] rpc_response_timeout = 120 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] run_external_periodic_tasks = True {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] scst_target_driver = iscsi {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] scst_target_iqn_name = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] service_down_time = 720 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] shell_completion = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] snapshot_name_template = snapshot-%s {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] snapshot_same_host = True {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] split_loggers = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] state_path = /opt/stack/data/cinder {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] storage_availability_zone = nova {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] storage_protocol = iSCSI {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] syslog_log_facility = LOG_USER {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] target_helper = lioadm {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] target_ip_address = 192.168.122.80 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] target_port = 3260 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] target_protocol = iscsi {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] target_secondary_ip_addresses = [] {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] trace_flags = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] transport_url = **** {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] until_refresh = 0 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] use_chap_auth = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] use_default_quota_class = True {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] use_journal = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] use_json = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] use_multipath_for_image_xfer = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] use_stderr = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] use_syslog = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] verify_glance_signatures = enabled {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] volume_api_class = cinder.volume.api.API {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] volume_backend_name = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] volume_clear = zero {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] volume_clear_ionice = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] volume_clear_size = 0 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] volume_copy_bps_limit = 0 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] volume_dd_blocksize = 1M {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] volume_name_template = volume-%s {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] volume_service_inithost_offload = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] volume_usage_audit_period = month {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] zoning_mode = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_concurrency.disable_process_locking = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.auth_section = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.auth_type = password {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.auth_version = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.cache = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.certfile = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.include_service_catalog = True {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.insecure = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.interface = public {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.keyfile = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.memcache_password = {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.memcache_username = {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.region_name = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.service_type = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.80/identity {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.backend = dogpile.cache.null {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.backend_argument = **** {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.backend_expiration_time = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.config_prefix = cache.oslo {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.debug_cache_backend = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.enable_retry_client = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.enable_socket_keepalive = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.enabled = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.expiration_time = 600 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.hashclient_retry_attempts = 2 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.memcache_dead_retry = 300 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.memcache_pool_maxsize = 10 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.memcache_sasl_enabled = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.password = **** {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.proxies = [] {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.redis_db = 0 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.redis_server = localhost:6379 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.retry_attempts = 2 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.retry_delay = 0.0 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.socket_keepalive_count = 1 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.socket_keepalive_idle = 1 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.socket_keepalive_interval = 1 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.socket_timeout = 1.0 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.tls_allowed_ciphers = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.tls_cafile = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.tls_certfile = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.tls_enabled = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.tls_keyfile = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cache.username = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] coordination.backend_url = **** {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] database.asyncio_connection = **** {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] database.asyncio_slave_connection = **** {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] database.backend = sqlalchemy {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] database.connection = **** {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] database.connection_debug = 0 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] database.connection_parameters = {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] database.connection_recycle_time = 3600 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] database.connection_trace = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] database.db_inc_retry_interval = True {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] database.db_max_retries = 20 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] database.db_max_retry_interval = 10 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] database.db_retry_interval = 1 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] database.max_overflow = 50 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] database.max_pool_size = 5 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] database.max_retries = 10 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] database.mysql_wsrep_sync_wait = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] database.pool_timeout = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] database.retry_interval = 10 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] database.slave_connection = **** {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] database.sqlite_synchronous = True {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] database.synchronous_reader = True {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] database.use_db_reconnect = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] profiler.connection_string = messaging:// {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] profiler.enabled = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] profiler.es_doc_type = notification {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] profiler.es_scroll_size = 10000 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] profiler.es_scroll_time = 2m {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] profiler.filter_error_trace = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] profiler.hmac_keys = **** {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] profiler.sentinel_service_name = mymaster {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] profiler.socket_timeout = 0.1 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] profiler.trace_requests = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] profiler.trace_sqlalchemy = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] profiler_jaeger.process_tags = {} {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] profiler_jaeger.service_name_prefix = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] profiler_otlp.service_name_prefix = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_policy.enforce_new_defaults = True {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_policy.policy_default_rule = default {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_policy.policy_file = policy.yaml {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] privsep_osbrick.group = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] privsep_osbrick.helper_command = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] privsep_osbrick.user = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cinder_sys_admin.group = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cinder_sys_admin.helper_command = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] cinder_sys_admin.user = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] service_user.auth_section = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] service_user.auth_type = password {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] service_user.cafile = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.062s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] service_user.certfile = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] service_user.collect_timing = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] service_user.insecure = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] service_user.keyfile = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] service_user.send_service_user_token = True {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] service_user.split_loggers = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] service_user.timeout = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] glance.auth_section = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] glance.auth_type = password {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] glance.certfile = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] glance.collect_timing = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] glance.insecure = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] glance.keyfile = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] glance.region_name = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] glance.split_loggers = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] glance.timeout = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.backend_availability_zone = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.chap_password = **** {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.chap_username = {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.disk_geometry = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.driver_client_cert = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.driver_client_cert_key = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.driver_data_namespace = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.driver_use_ssl = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.extra_capabilities = {} {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.filter_function = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.goodness_function = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.iscsi_target_flags = {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.iscsi_write_cache = on {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.iser_helper = tgtadm {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.iser_ip_address = 192.168.122.80 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.iser_port = 3260 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.lvm_share_target = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.lvm_type = auto {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.num_shell_tries = 3 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.replication_device = **** {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.report_discard_supported = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.reserved_percentage = 0 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.target_helper = tgtadm {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.target_ip_address = 192.168.122.80 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.target_port = 3260 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.target_protocol = iscsi {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.trace_flags = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.unique_fqdn_network = True {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.use_chap_auth = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.volume_backend_name = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.volume_clear = zero {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.volume_clear_ionice = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.volume_clear_size = 0 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_reports.file_event_handler = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_reports.log_dir = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.backend_host = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.chap_password = **** {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.chap_username = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.disk_geometry = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.driver_client_cert = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.extra_capabilities = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.filter_function = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.goodness_function = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.iser_helper = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.iser_ip_address = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.iser_port = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.lvm_share_target = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.lvm_type = auto {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.num_shell_tries = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.replication_device = **** {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.report_discard_supported = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.reserved_percentage = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.scst_target_driver = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.storage_protocol = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.target_helper = lioadm {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.target_ip_address = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.target_port = 3260 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.trace_flags = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.use_chap_auth = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.volume_clear = zero {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.volume_clear_size = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] lvmdriver-1.volumes_dir = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.ssl = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack sudo[76524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 21 02:00:07 devstack sudo[76524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_notifications.driver = [] {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_notifications.retry = -1 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] key_manager.fixed_key = **** {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] barbican.barbican_api_version = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] barbican.barbican_endpoint = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] barbican.barbican_endpoint_type = public {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] barbican.barbican_region_name = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] barbican.cafile = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] barbican.certfile = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] barbican.collect_timing = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] barbican.insecure = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] barbican.keyfile = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] barbican.number_of_retries = 60 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] barbican.retry_delay = 1 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] barbican.send_service_user_token = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] barbican.split_loggers = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] barbican.timeout = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] barbican.verify_ssl = True {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] barbican.verify_ssl_path = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] barbican_service_user.auth_section = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] barbican_service_user.auth_type = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] barbican_service_user.cafile = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] barbican_service_user.certfile = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] barbican_service_user.collect_timing = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] barbican_service_user.insecure = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] barbican_service_user.keyfile = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] barbican_service_user.split_loggers = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] barbican_service_user.timeout = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] vault.approle_role_id = **** {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] vault.approle_secret_id = **** {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] vault.auth_method = approle {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] vault.auth_path = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] vault.kv_mountpoint = secret {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] vault.kv_path = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] vault.kv_version = 2 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] vault.namespace = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] vault.root_token_id = **** {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] vault.ssl_ca_crt_file = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] vault.timeout = 60.0 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] vault.token_file = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] vault.token_role = None {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] vault.use_ssl = False {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:00:07 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] ******************************************************************************** {{(pid=76370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 21 02:00:07 devstack sudo[76524]: pam_unix(sudo:session): session closed for user root Jul 21 02:00:07 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:00:07 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:00:07 devstack sudo[76594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 02:00:07 devstack sudo[76594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:00:07 devstack sudo[76594]: pam_unix(sudo:session): session closed for user root Jul 21 02:00:07 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.256s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:00:07 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 02:00:07 devstack cinder-volume[76517]: INFO cinder.brick.local_dev.lvm [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 21 02:00:07 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:00:07 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:00:07 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:00:07 devstack sudo[76713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 02:00:07 devstack sudo[76713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:00:08 devstack sudo[76713]: pam_unix(sudo:session): session closed for user root Jul 21 02:00:08 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:00:08 devstack cinder-volume[76517]: DEBUG cinder.brick.local_dev.lvm [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76517) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 21 02:00:08 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:00:08 devstack sudo[76804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 02:00:08 devstack sudo[76804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:00:08 devstack sudo[76804]: pam_unix(sudo:session): session closed for user root Jul 21 02:00:08 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.552s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:00:08 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:00:08 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:00:08 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:00:08 devstack sudo[77004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 02:00:08 devstack sudo[77004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:00:09 devstack sudo[77004]: pam_unix(sudo:session): session closed for user root Jul 21 02:00:09 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:00:09 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:00:09 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:00:09 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:00:09 devstack sudo[77129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 21 02:00:09 devstack sudo[77129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:00:09 devstack sudo[77129]: pam_unix(sudo:session): session closed for user root Jul 21 02:00:09 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.262s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:00:09 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:00:09 devstack sudo[77132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 02:00:09 devstack sudo[77132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:00:09 devstack sudo[77132]: pam_unix(sudo:session): session closed for user root Jul 21 02:00:09 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.325s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:00:09 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:00:09 devstack sudo[77215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 02:00:09 devstack sudo[77215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:00:09 devstack sudo[77215]: pam_unix(sudo:session): session closed for user root Jul 21 02:00:09 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:00:09 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:00:09 devstack sudo[77218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 02:00:09 devstack sudo[77218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:00:10 devstack sudo[77218]: pam_unix(sudo:session): session closed for user root Jul 21 02:00:10 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:00:10 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:00:10 devstack sudo[77271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 02:00:10 devstack sudo[77271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:00:10 devstack sudo[77271]: pam_unix(sudo:session): session closed for user root Jul 21 02:00:10 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.322s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:00:10 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:00:10 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:00:10 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:00:10 devstack sudo[77311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 02:00:10 devstack sudo[77311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:00:10 devstack sudo[77311]: pam_unix(sudo:session): session closed for user root Jul 21 02:00:10 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:00:10 devstack cinder-volume[76517]: INFO cinder.volume.drivers.lvm [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 21 02:00:10 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:00:10 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:00:10 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:00:10 devstack sudo[77315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 02:00:10 devstack sudo[77315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:00:11 devstack sudo[77315]: pam_unix(sudo:session): session closed for user root Jul 21 02:00:11 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:00:11 devstack cinder-volume[76517]: DEBUG cinder.volume.drivers.lvm [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Updating volume stats {{(pid=76517) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 02:00:11 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:00:11 devstack sudo[77318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 02:00:11 devstack sudo[77318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:00:11 devstack sudo[77318]: pam_unix(sudo:session): session closed for user root Jul 21 02:00:11 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:00:11 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:00:11 devstack sudo[77322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 02:00:11 devstack sudo[77322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:00:11 devstack sudo[77322]: pam_unix(sudo:session): session closed for user root Jul 21 02:00:11 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:00:11 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:00:11 devstack sudo[77331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 02:00:11 devstack sudo[77331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:00:12 devstack sudo[77331]: pam_unix(sudo:session): session closed for user root Jul 21 02:00:12 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:00:12 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:00:12 devstack sudo[77334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 02:00:12 devstack sudo[77334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:00:12 devstack sudo[77334]: pam_unix(sudo:session): session closed for user root Jul 21 02:00:12 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:00:12 devstack cinder-volume[76517]: INFO cinder.volume.driver [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Driver hasn't implemented _init_vendor_properties() Jul 21 02:00:12 devstack cinder-volume[76517]: DEBUG cinder.volume.driver [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76517) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 21 02:00:12 devstack cinder-volume[76517]: DEBUG oslo_db.sqlalchemy.engines [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76517) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 02:00:12 devstack cinder-volume[76517]: DEBUG dbcounter [-] [76517] Writer thread running {{(pid=76517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 02:00:12 devstack cinder-volume[76517]: DEBUG cinder.db.api [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Building query based on filter {{(pid=76517) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 21 02:00:12 devstack cinder-volume[76517]: DEBUG cinder.image.image_utils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76517) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 21 02:00:12 devstack cinder-volume[76517]: INFO cinder.keymgr.migration [None req-7273f2cc-db41-4a1b-9149-24145fc6dbb6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 21 02:00:12 devstack cinder-volume[76517]: DEBUG cinder.volume.drivers.lvm [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Updating volume stats {{(pid=76517) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 02:00:12 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:00:12 devstack sudo[77340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 02:00:12 devstack sudo[77340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:00:12 devstack sudo[77340]: pam_unix(sudo:session): session closed for user root Jul 21 02:00:12 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:00:12 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:00:12 devstack sudo[77343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 02:00:12 devstack sudo[77343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:00:12 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:00:12 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:00:12 devstack sudo[77343]: pam_unix(sudo:session): session closed for user root Jul 21 02:00:13 devstack sudo[77346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 02:00:13 devstack sudo[77346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:00:13 devstack sudo[77346]: pam_unix(sudo:session): session closed for user root Jul 21 02:00:13 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:00:13 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:00:13 devstack sudo[77349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 02:00:13 devstack sudo[77349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:00:13 devstack sudo[77349]: pam_unix(sudo:session): session closed for user root Jul 21 02:00:13 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:00:13 devstack cinder-volume[76517]: DEBUG cinder.manager [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Notifying Schedulers of capabilities ... {{(pid=76517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:00:13 devstack cinder-volume[76517]: INFO cinder.volume.manager [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Driver initialization completed successfully. Jul 21 02:00:13 devstack cinder-volume[76517]: INFO cinder.manager [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Initiating service 2 cleanup Jul 21 02:00:13 devstack cinder-volume[76517]: INFO cinder.manager [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Service 2 cleanup completed. Jul 21 02:00:13 devstack cinder-volume[76517]: DEBUG cinder.service [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Creating RPC server for service cinder-volume {{(pid=76517) start /opt/stack/cinder/cinder/service.py:231}} Jul 21 02:00:13 devstack cinder-volume[76517]: DEBUG cinder.service [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76517) start /opt/stack/cinder/cinder/service.py:237}} Jul 21 02:00:13 devstack cinder-volume[76517]: INFO cinder.volume.manager [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 21 02:00:13 devstack cinder-volume[76517]: DEBUG cinder.volume.drivers.lvm [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Updating volume stats {{(pid=76517) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 02:00:13 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:00:13 devstack sudo[77354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 02:00:13 devstack sudo[77354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:00:13 devstack sudo[77354]: pam_unix(sudo:session): session closed for user root Jul 21 02:00:13 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:00:13 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:00:13 devstack sudo[77357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 02:00:13 devstack sudo[77357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:00:14 devstack sudo[77357]: pam_unix(sudo:session): session closed for user root Jul 21 02:00:14 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:00:14 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:00:14 devstack sudo[77360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 02:00:14 devstack sudo[77360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:00:14 devstack sudo[77360]: pam_unix(sudo:session): session closed for user root Jul 21 02:00:14 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:00:14 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:00:14 devstack sudo[77363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 02:00:14 devstack sudo[77363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:00:14 devstack sudo[77363]: pam_unix(sudo:session): session closed for user root Jul 21 02:00:14 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:00:14 devstack cinder-volume[76517]: INFO cinder.volume.manager [None req-af854920-d0cf-46eb-b812-2d8c1fedf77a None None] Driver post RPC initialization completed successfully. Jul 21 02:00:17 devstack cinder-volume[76370]: DEBUG dbcounter [-] [76370] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76370) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:00:24 devstack cinder-volume[76517]: DEBUG dbcounter [-] [76517] Writing DB stats cinder:SELECT=4 {{(pid=76517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:00:24 devstack cinder-volume[76517]: DEBUG dbcounter [-] [76517] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:00:52 devstack cinder-volume[76517]: DEBUG oslo_service.periodic_task [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] Running periodic task VolumeManager._thread_info {{(pid=76517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:00:52 devstack cinder-volume[76517]: DEBUG cinder.volume.manager [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] thread count: 6 {{(pid=76517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 02:00:52 devstack cinder-volume[76517]: DEBUG cinder.volume.manager [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] thread info: [<_MainThread(MainThread, started 138316652609664)>, , , , , ] {{(pid=76517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 02:01:52 devstack cinder-volume[76517]: DEBUG oslo_service.periodic_task [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:01:52 devstack cinder-volume[76517]: DEBUG cinder.volume.drivers.lvm [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] Updating volume stats {{(pid=76517) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 02:01:52 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:01:52 devstack sudo[82569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 02:01:52 devstack sudo[82569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:01:53 devstack sudo[82569]: pam_unix(sudo:session): session closed for user root Jul 21 02:01:53 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:01:53 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:01:53 devstack sudo[82573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 02:01:53 devstack sudo[82573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:01:53 devstack sudo[82573]: pam_unix(sudo:session): session closed for user root Jul 21 02:01:53 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:01:53 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:01:53 devstack sudo[82576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 02:01:53 devstack sudo[82576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:01:53 devstack sudo[82576]: pam_unix(sudo:session): session closed for user root Jul 21 02:01:53 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:01:53 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:01:53 devstack sudo[82579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 02:01:53 devstack sudo[82579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:01:53 devstack sudo[82579]: pam_unix(sudo:session): session closed for user root Jul 21 02:01:53 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:01:53 devstack cinder-volume[76517]: DEBUG cinder.manager [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] Notifying Schedulers of capabilities ... {{(pid=76517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:01:53 devstack cinder-volume[76517]: DEBUG oslo_service.periodic_task [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] Running periodic task VolumeManager._thread_info {{(pid=76517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:01:53 devstack cinder-volume[76517]: DEBUG cinder.volume.manager [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] thread count: 6 {{(pid=76517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 02:01:53 devstack cinder-volume[76517]: DEBUG cinder.volume.manager [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] thread info: [<_MainThread(MainThread, started 138316652609664)>, , , , , ] {{(pid=76517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 02:02:24 devstack cinder-volume[76517]: DEBUG dbcounter [-] [76517] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:02:52 devstack cinder-volume[76517]: DEBUG oslo_service.periodic_task [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:02:52 devstack cinder-volume[76517]: DEBUG cinder.volume.drivers.lvm [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] Updating volume stats {{(pid=76517) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 02:02:52 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:02:52 devstack sudo[84057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 02:02:52 devstack sudo[84057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:02:53 devstack sudo[84057]: pam_unix(sudo:session): session closed for user root Jul 21 02:02:53 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:02:53 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:02:53 devstack sudo[84065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 02:02:53 devstack sudo[84065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:02:53 devstack sudo[84065]: pam_unix(sudo:session): session closed for user root Jul 21 02:02:53 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:02:53 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:02:53 devstack sudo[84070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 02:02:53 devstack sudo[84070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:02:53 devstack sudo[84070]: pam_unix(sudo:session): session closed for user root Jul 21 02:02:53 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:02:53 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:02:53 devstack sudo[84080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 02:02:53 devstack sudo[84080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:02:53 devstack sudo[84080]: pam_unix(sudo:session): session closed for user root Jul 21 02:02:53 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:02:53 devstack cinder-volume[76517]: DEBUG cinder.manager [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] Notifying Schedulers of capabilities ... {{(pid=76517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:02:53 devstack cinder-volume[76517]: DEBUG oslo_service.periodic_task [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] Running periodic task VolumeManager._thread_info {{(pid=76517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:02:53 devstack cinder-volume[76517]: DEBUG cinder.volume.manager [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] thread count: 6 {{(pid=76517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 02:02:53 devstack cinder-volume[76517]: DEBUG cinder.volume.manager [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] thread info: [<_MainThread(MainThread, started 138316652609664)>, , , , , ] {{(pid=76517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 02:03:52 devstack cinder-volume[76517]: DEBUG oslo_service.periodic_task [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:03:52 devstack cinder-volume[76517]: DEBUG cinder.volume.drivers.lvm [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] Updating volume stats {{(pid=76517) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 02:03:52 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:03:52 devstack sudo[85517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 02:03:52 devstack sudo[85517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:03:53 devstack sudo[85517]: pam_unix(sudo:session): session closed for user root Jul 21 02:03:53 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:03:53 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:03:53 devstack sudo[85520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 02:03:53 devstack sudo[85520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:03:53 devstack sudo[85520]: pam_unix(sudo:session): session closed for user root Jul 21 02:03:53 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:03:53 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:03:53 devstack sudo[85534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 02:03:53 devstack sudo[85534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:03:53 devstack sudo[85534]: pam_unix(sudo:session): session closed for user root Jul 21 02:03:53 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:03:53 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:03:53 devstack sudo[85537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 02:03:53 devstack sudo[85537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:03:53 devstack sudo[85537]: pam_unix(sudo:session): session closed for user root Jul 21 02:03:53 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:03:53 devstack cinder-volume[76517]: DEBUG cinder.manager [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] Notifying Schedulers of capabilities ... {{(pid=76517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:03:53 devstack cinder-volume[76517]: DEBUG oslo_service.periodic_task [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] Running periodic task VolumeManager._thread_info {{(pid=76517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:03:53 devstack cinder-volume[76517]: DEBUG cinder.volume.manager [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] thread count: 6 {{(pid=76517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 02:03:53 devstack cinder-volume[76517]: DEBUG cinder.volume.manager [None req-76a9a33b-162d-49a2-9d61-76b087fa2cdc None None] thread info: [<_MainThread(MainThread, started 138316652609664)>, , , , , ] {{(pid=76517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 02:04:24 devstack cinder-volume[76517]: DEBUG dbcounter [-] [76517] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:04:42 devstack cinder-volume[76370]: INFO oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] Caught SIGTERM, stopping children Jul 21 02:04:42 devstack cinder-volume[76370]: DEBUG oslo_concurrency.lockutils [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] Acquiring lock "singleton_lock" {{(pid=76370) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 02:04:42 devstack cinder-volume[76370]: DEBUG oslo_concurrency.lockutils [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] Acquired lock "singleton_lock" {{(pid=76370) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 02:04:42 devstack cinder-volume[76370]: DEBUG oslo_concurrency.lockutils [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] Releasing lock "singleton_lock" {{(pid=76370) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 02:04:42 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] Stop services. {{(pid=76370) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 21 02:04:42 devstack cinder-volume[76370]: DEBUG oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] Killing children. {{(pid=76370) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 21 02:04:42 devstack cinder-volume[76370]: INFO oslo_service.backend._eventlet.service [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] Waiting on 1 children to exit Jul 21 02:04:47 devstack cinder-volume[76517]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 21 02:04:48 devstack cinder-volume[86615]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 21 02:04:48 devstack cinder-volume[86615]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 21 02:04:48 devstack cinder-volume[86615]: we strongly recommend against using it for new projects. Jul 21 02:04:48 devstack cinder-volume[86615]: If you are already using Eventlet, we recommend migrating to a different Jul 21 02:04:48 devstack cinder-volume[86615]: framework. For more detail see Jul 21 02:04:48 devstack cinder-volume[86615]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 21 02:04:48 devstack cinder-volume[86615]: import eventlet # noqa Jul 21 02:04:48 devstack cinder-volume[76517]: DEBUG oslo_concurrency.lockutils [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] Acquiring lock "singleton_lock" {{(pid=76517) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 02:04:48 devstack cinder-volume[76517]: DEBUG oslo_concurrency.lockutils [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] Acquired lock "singleton_lock" {{(pid=76517) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 02:04:48 devstack cinder-volume[76517]: DEBUG oslo_concurrency.lockutils [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] Releasing lock "singleton_lock" {{(pid=76517) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 02:04:48 devstack cinder-volume[76517]: WARNING amqp [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 21 02:04:48 devstack cinder-volume[76517]: WARNING amqp [None req-14dcbb24-ea1d-4dcd-be0b-aab0a86f6762 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 21 02:04:50 devstack cinder-volume[86615]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86615) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 02:04:50 devstack cinder-volume[86615]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86615) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 02:04:50 devstack cinder-volume[86615]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86615) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 02:04:50 devstack cinder-volume[86615]: INFO dbcounter [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] Registered counter for database cinder Jul 21 02:04:50 devstack cinder-volume[86615]: DEBUG oslo_db.sqlalchemy.engines [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86615) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG dbcounter [-] [86615] Writer thread running {{(pid=86615) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 02:04:51 devstack cinder-volume[86615]: INFO cinder.rpc [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 21 02:04:51 devstack cinder-volume[86615]: INFO cinder.rpc [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_db.sqlalchemy.engines [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86615) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 02:04:51 devstack cinder-volume[86615]: INFO cinder.volume.manager [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] Determined volume DB was empty at startup. Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG cinder.volume.manager [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86615) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 21 02:04:51 devstack cinder-volume[86615]: INFO cinder.volume.manager [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 21 02:04:51 devstack cinder-volume[86615]: WARNING stevedore.named [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 21 02:04:51 devstack cinder-volume[86615]: WARNING castellan.key_manager [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 02:04:51 devstack cinder-volume[86615]: WARNING cinder.keymgr.conf_key_mgr [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 02:04:51 devstack cinder-volume[86615]: INFO cinder.volume.manager [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_db.sqlalchemy.engines [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86615) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 02:04:51 devstack cinder-volume[86615]: INFO oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] Starting 1 workers Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] Started child 86835 {{(pid=86615) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] Full set of CONF: {{(pid=86615) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] ******************************************************************************** {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] Configuration options gathered from: {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] ================================================================================ {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] allow_availability_zone_fallback = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] allow_compression_on_image_upload = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] allowed_direct_url_schemes = [] {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86835]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] api_rate_limit = True {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] auth_strategy = keystone {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_availability_zone = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_host = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_name = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_stats_polling_interval = 60 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backup_api_class = cinder.backup.api.API {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backup_name_template = backup-%s {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backup_use_same_host = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backup_use_temp_snapshot = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] chap_password = **** {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] chap_username = {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cinder_internal_tenant_project_id = be39213244aa4f9aaafdbaa630944738 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cinder_internal_tenant_user_id = a6c78acc4a5047548c4c5976a5ec5857 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cluster = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] compression_format = gzip {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] compute_api_class = cinder.compute.nova.API {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] config_dir = [] {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] config_source = [] {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] control_exchange = openstack {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] debug = True {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] default_availability_zone = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] default_group_type = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] default_volume_type = QuobyteHD {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] disk_geometry = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] driver_client_cert = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] driver_client_cert_key = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] driver_data_namespace = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] driver_ssl_cert_path = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] driver_ssl_cert_verify = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] driver_use_ssl = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] enable_new_services = True {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] enable_unsupported_driver = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] enabled_backends = ['QuobyteHD'] {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] enforce_multipath_for_image_xfer = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] filter_function = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] glance_api_insecure = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] glance_api_servers = ['http://192.168.122.80/image'] {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] glance_api_ssl_compression = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] glance_ca_certificates_file = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] glance_catalog_info = image:glance:publicURL {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] glance_certfile = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] glance_keyfile = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] glance_num_retries = 3 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] glance_request_timeout = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] goodness_function = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] graceful_shutdown_timeout = 5 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] group_api_class = cinder.group.api.API {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] host = devstack {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] image_compress_on_upload = True {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] image_conversion_address_space_limit = 1 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] image_conversion_cpu_limit = 60 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] image_conversion_disable = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] image_upload_use_cinder_backend = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] image_upload_use_internal_tenant = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] image_volume_cache_enabled = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] image_volume_cache_max_count = 0 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] image_volume_cache_max_size_gb = 0 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] init_host_max_objects_retrieval = 0 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] instance_format = [instance: %(uuid)s] {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] iscsi_target_flags = {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] iscsi_write_cache = on {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] iser_helper = tgtadm {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] iser_ip_address = 192.168.122.80 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] iser_port = 3260 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] log_color = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] log_config_append = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] log_dir = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] log_file = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] log_options = True {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] log_rotate_interval = 1 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] log_rotate_interval_type = days {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] log_rotation_type = none {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86835]: INFO cinder.volume.manager [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Starting volume driver QuobyteDriver (1.2) Jul 21 02:04:51 devstack cinder-volume[86835]: DEBUG cinder.volume.drivers.remotefs [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86835) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] max_age = 0 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] max_logfile_count = 30 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] max_logfile_size_mb = 200 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] max_over_subscription_ratio = 20.0 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] message_reap_interval = 86400 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] message_ttl = 2592000 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] migration_create_volume_timeout_secs = 300 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] monkey_patch = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] monkey_patch_modules = [] {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] my_ip = 192.168.122.80 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] no_snapshot_gb_quota = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] num_iser_scan_tries = 3 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] num_shell_tries = 3 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] num_volume_device_scan_tries = 3 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] nvmeof_conn_info_version = 1 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] nvmet_ns_id = 10 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] nvmet_port_id = 1 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] osapi_max_limit = 1000 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] osapi_volume_ext_list = [] {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] osapi_volume_listen_port = 8776 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] osapi_volume_use_ssl = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] osapi_volume_workers = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] per_volume_size_limit = -1 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] periodic_fuzzy_delay = 60 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] periodic_interval = 60 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] public_endpoint = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] publish_errors = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] quota_backup_gigabytes = 1000 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] quota_backups = 10 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] quota_gigabytes = 1000 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] quota_groups = 10 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] quota_snapshots = 10 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] quota_volumes = 10 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] rate_limit_burst = 0 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] rate_limit_except_level = CRITICAL {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] rate_limit_interval = 0 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] reinit_driver_count = 3 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] replication_device = **** {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] report_discard_supported = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] report_interval = 120 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] reservation_clean_interval = 86400 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] reservation_expire = 86400 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] reserved_image_namespaces = [] {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] reserved_percentage = 0 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] rpc_response_timeout = 120 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] run_external_periodic_tasks = True {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] scst_target_driver = iscsi {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] scst_target_iqn_name = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] service_down_time = 720 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] shell_completion = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] snapshot_name_template = snapshot-%s {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] split_loggers = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] state_path = /opt/stack/data/cinder {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] storage_availability_zone = nova {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] storage_protocol = iSCSI {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] syslog_log_facility = LOG_USER {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] target_helper = lioadm {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] target_ip_address = 192.168.122.80 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] target_port = 3260 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] target_protocol = iscsi {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] target_secondary_ip_addresses = [] {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] trace_flags = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] transport_url = **** {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] until_refresh = 0 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] use_chap_auth = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] use_default_quota_class = True {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] use_journal = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] use_json = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] use_multipath_for_image_xfer = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] use_stderr = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] use_syslog = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] verify_glance_signatures = enabled {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] volume_api_class = cinder.volume.api.API {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] volume_backend_name = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] volume_clear = zero {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] volume_clear_ionice = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] volume_clear_size = 0 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] volume_copy_bps_limit = 0 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] volume_dd_blocksize = 1M {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] volume_name_template = volume-%s {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] volume_service_inithost_offload = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] volume_usage_audit_period = month {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] zoning_mode = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_concurrency.disable_process_locking = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.auth_section = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.auth_type = password {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.auth_version = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.cache = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.certfile = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.include_service_catalog = True {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.insecure = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.interface = public {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.keyfile = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.memcache_password = {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.memcache_username = {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.region_name = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.service_type = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.80/identity {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.backend = dogpile.cache.null {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.backend_argument = **** {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.backend_expiration_time = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.config_prefix = cache.oslo {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.debug_cache_backend = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.enable_retry_client = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.enable_socket_keepalive = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.enabled = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.expiration_time = 600 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.hashclient_retry_attempts = 2 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.memcache_dead_retry = 300 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.memcache_pool_maxsize = 10 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.memcache_sasl_enabled = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.password = **** {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.proxies = [] {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.redis_db = 0 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86835]: DEBUG cinder.volume.drivers.quobyte [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86835) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 21 02:04:51 devstack cinder-volume[86835]: WARNING cinder.volume.drivers.quobyte [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.redis_server = localhost:6379 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.retry_attempts = 2 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.retry_delay = 0.0 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.socket_keepalive_count = 1 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.socket_keepalive_idle = 1 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.socket_keepalive_interval = 1 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.socket_timeout = 1.0 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.tls_allowed_ciphers = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86835]: WARNING cinder.volume.drivers.quobyte [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.tls_cafile = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.tls_certfile = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86835]: DEBUG oslo_concurrency.processutils [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Running cmd (subprocess): mount.quobyte {{(pid=86835) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.tls_enabled = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.tls_keyfile = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cache.username = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] coordination.backend_url = **** {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] database.asyncio_connection = **** {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] database.asyncio_slave_connection = **** {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] database.backend = sqlalchemy {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] database.connection = **** {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] database.connection_debug = 0 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] database.connection_parameters = {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] database.connection_recycle_time = 3600 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] database.connection_trace = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] database.db_inc_retry_interval = True {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] database.db_max_retries = 20 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] database.db_max_retry_interval = 10 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] database.db_retry_interval = 1 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] database.max_overflow = 50 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] database.max_pool_size = 5 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] database.max_retries = 10 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] database.mysql_wsrep_sync_wait = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] database.pool_timeout = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] database.retry_interval = 10 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] database.slave_connection = **** {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] database.sqlite_synchronous = True {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] database.synchronous_reader = True {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] database.use_db_reconnect = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] profiler.connection_string = messaging:// {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] profiler.enabled = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] profiler.es_doc_type = notification {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] profiler.es_scroll_size = 10000 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] profiler.es_scroll_time = 2m {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] profiler.filter_error_trace = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] profiler.hmac_keys = **** {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] profiler.sentinel_service_name = mymaster {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] profiler.socket_timeout = 0.1 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] profiler.trace_requests = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] profiler.trace_sqlalchemy = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] profiler_jaeger.process_tags = {} {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] profiler_jaeger.service_name_prefix = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] profiler_otlp.service_name_prefix = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_policy.enforce_new_defaults = True {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_policy.policy_default_rule = default {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_policy.policy_file = policy.yaml {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] privsep_osbrick.group = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] privsep_osbrick.helper_command = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] privsep_osbrick.user = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cinder_sys_admin.group = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cinder_sys_admin.helper_command = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] cinder_sys_admin.user = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] service_user.auth_section = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] service_user.auth_type = password {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] service_user.cafile = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] service_user.certfile = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] service_user.collect_timing = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] service_user.insecure = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] service_user.keyfile = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] service_user.send_service_user_token = True {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] service_user.split_loggers = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] service_user.timeout = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] glance.auth_section = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] glance.auth_type = password {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] glance.certfile = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] glance.collect_timing = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] glance.insecure = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] glance.keyfile = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] glance.region_name = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] glance.split_loggers = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] glance.timeout = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.backend_availability_zone = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.chap_password = **** {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.chap_username = {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.disk_geometry = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.driver_client_cert = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.driver_client_cert_key = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.driver_data_namespace = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.driver_use_ssl = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.extra_capabilities = {} {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.filter_function = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.goodness_function = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.iscsi_target_flags = {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.iscsi_write_cache = on {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.iser_helper = tgtadm {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.iser_ip_address = 192.168.122.80 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.iser_port = 3260 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.nas_host = {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.nas_login = admin {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.nas_mount_options = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.nas_password = **** {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.nas_private_key = {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.nas_share_path = {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack quobyte-client[86837]: Reading configuration file: /etc/quobyte/client.cfg Jul 21 02:04:51 devstack quobyte-client[86837]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.num_shell_tries = 3 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.quobyte_volume_url = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.replication_device = **** {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.report_discard_supported = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.reserved_percentage = 0 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.target_helper = tgtadm {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.target_ip_address = 192.168.122.80 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.target_port = 3260 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.target_protocol = iscsi {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86835]: DEBUG oslo_concurrency.processutils [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] CMD "mount.quobyte" returned: 1 in 0.137s {{(pid=86835) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.trace_flags = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.unique_fqdn_network = True {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.use_chap_auth = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.volume_backend_name = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.volume_clear = zero {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.volume_clear_ionice = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.volume_clear_size = 0 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86835]: DEBUG oslo_concurrency.lockutils [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86835) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86835]: DEBUG oslo_concurrency.lockutils [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86835) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86835]: DEBUG cinder.volume.drivers.quobyte [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=86835) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_reports.file_event_handler = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86835]: INFO cinder.volume.drivers.quobyte [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea ... Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_reports.log_dir = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.backend_availability_zone = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.backend_host = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86835]: DEBUG oslo_concurrency.processutils [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc -c /etc/quobyte/client-cinder.cfg {{(pid=86835) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.chap_password = **** {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.chap_username = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.chiscsi_conf = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.disk_geometry = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.driver_client_cert = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.driver_data_namespace = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.driver_use_ssl = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.extra_capabilities = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.filter_function = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.goodness_function = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.iser_helper = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.iser_ip_address = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.iser_port = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.iser_target_prefix = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.nas_host = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.nas_login = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.nas_mount_options = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.nas_password = **** {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.nas_private_key = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.nas_share_path = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.nas_ssh_port = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.num_shell_tries = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.nvmet_port_id = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.replication_device = **** {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.report_discard_supported = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.reserved_percentage = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.scst_target_driver = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.storage_protocol = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.target_helper = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.target_ip_address = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.target_port = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.target_prefix = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.target_protocol = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.trace_flags = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.use_chap_auth = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.volume_clear = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.volume_clear_size = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] QuobyteHD.volumes_dir = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack sudo[86843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc -c /etc/quobyte/client-cinder.cfg Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack sudo[86843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.ssl = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_notifications.driver = [] {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_notifications.retry = -1 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] key_manager.fixed_key = **** {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] barbican.barbican_api_version = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] barbican.barbican_endpoint = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] barbican.barbican_endpoint_type = public {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] barbican.barbican_region_name = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] barbican.cafile = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] barbican.certfile = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] barbican.collect_timing = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] barbican.insecure = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] barbican.keyfile = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] barbican.number_of_retries = 60 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] barbican.retry_delay = 1 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] barbican.send_service_user_token = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] barbican.split_loggers = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] barbican.timeout = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] barbican.verify_ssl = True {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] barbican.verify_ssl_path = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] barbican_service_user.auth_section = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] barbican_service_user.auth_type = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] barbican_service_user.cafile = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] barbican_service_user.certfile = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] barbican_service_user.collect_timing = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] barbican_service_user.insecure = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] barbican_service_user.keyfile = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] barbican_service_user.split_loggers = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] barbican_service_user.timeout = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] vault.approle_role_id = **** {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] vault.approle_secret_id = **** {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] vault.auth_method = approle {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] vault.auth_path = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] vault.kv_mountpoint = secret {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] vault.kv_path = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] vault.kv_version = 2 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] vault.namespace = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] vault.root_token_id = **** {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] vault.ssl_ca_crt_file = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] vault.timeout = 60.0 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] vault.token_file = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] vault.token_role = None {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] vault.use_ssl = False {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:04:51 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] ******************************************************************************** {{(pid=86615) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 21 02:04:52 devstack sudo[86843]: pam_unix(sudo:session): session closed for user root Jul 21 02:04:52 devstack cinder-volume[86835]: DEBUG oslo_concurrency.processutils [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.429s {{(pid=86835) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:04:52 devstack cinder-volume[86835]: INFO cinder.volume.drivers.quobyte [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea succeeded Jul 21 02:04:52 devstack cinder-volume[86835]: DEBUG cinder.volume.drivers.quobyte [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=86835) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:04:52 devstack cinder-volume[86835]: DEBUG oslo_concurrency.lockutils [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.438s {{(pid=86835) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:04:52 devstack cinder-volume[86835]: DEBUG oslo_concurrency.processutils [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=86835) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:04:52 devstack sudo[86918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:04:52 devstack sudo[86918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:04:52 devstack sudo[86918]: pam_unix(sudo:session): session closed for user root Jul 21 02:04:52 devstack cinder-volume[86835]: DEBUG oslo_concurrency.processutils [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.250s {{(pid=86835) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:04:52 devstack cinder-volume[86835]: INFO cinder.volume.driver [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Driver hasn't implemented _init_vendor_properties() Jul 21 02:04:52 devstack cinder-volume[86835]: DEBUG cinder.volume.driver [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86835) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 21 02:04:52 devstack cinder-volume[86835]: DEBUG oslo_db.sqlalchemy.engines [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86835) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 02:04:52 devstack cinder-volume[86835]: DEBUG dbcounter [-] [86835] Writer thread running {{(pid=86835) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 02:04:52 devstack cinder-volume[86835]: DEBUG cinder.db.api [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Building query based on filter {{(pid=86835) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 21 02:04:52 devstack cinder-volume[86835]: DEBUG cinder.image.image_utils [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86835) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 21 02:04:52 devstack cinder-volume[86835]: INFO cinder.keymgr.migration [None req-192f00b2-b07b-4c9c-a95c-6d1a0414b6f9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 21 02:04:52 devstack cinder-volume[86835]: DEBUG oslo_concurrency.lockutils [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86835) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:04:52 devstack cinder-volume[86835]: DEBUG oslo_concurrency.lockutils [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86835) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:04:52 devstack cinder-volume[86835]: DEBUG cinder.volume.drivers.quobyte [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=86835) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:04:52 devstack cinder-volume[86835]: DEBUG cinder.volume.drivers.quobyte [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=86835) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:04:52 devstack cinder-volume[86835]: DEBUG oslo_concurrency.lockutils [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86835) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:04:52 devstack cinder-volume[86835]: DEBUG oslo_concurrency.processutils [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=86835) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:04:52 devstack sudo[86921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:04:52 devstack sudo[86921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:04:52 devstack sudo[86921]: pam_unix(sudo:session): session closed for user root Jul 21 02:04:52 devstack cinder-volume[86835]: DEBUG oslo_concurrency.processutils [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.248s {{(pid=86835) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:04:52 devstack cinder-volume[86835]: DEBUG cinder.manager [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Notifying Schedulers of capabilities ... {{(pid=86835) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:04:52 devstack cinder-volume[86835]: INFO cinder.volume.manager [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Driver initialization completed successfully. Jul 21 02:04:52 devstack cinder-volume[86835]: INFO cinder.manager [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Initiating service 3 cleanup Jul 21 02:04:52 devstack cinder-volume[86835]: INFO cinder.manager [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Service 3 cleanup completed. Jul 21 02:04:52 devstack cinder-volume[86835]: DEBUG cinder.service [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Creating RPC server for service cinder-volume {{(pid=86835) start /opt/stack/cinder/cinder/service.py:231}} Jul 21 02:04:52 devstack cinder-volume[86835]: DEBUG cinder.service [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86835) start /opt/stack/cinder/cinder/service.py:237}} Jul 21 02:04:53 devstack cinder-volume[86835]: INFO cinder.volume.manager [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 21 02:04:53 devstack cinder-volume[86835]: DEBUG oslo_concurrency.lockutils [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86835) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:04:53 devstack cinder-volume[86835]: DEBUG oslo_concurrency.lockutils [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86835) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:04:53 devstack cinder-volume[86835]: DEBUG cinder.volume.drivers.quobyte [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=86835) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:04:53 devstack cinder-volume[86835]: DEBUG cinder.volume.drivers.quobyte [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=86835) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:04:53 devstack cinder-volume[86835]: DEBUG oslo_concurrency.lockutils [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86835) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:04:53 devstack cinder-volume[86835]: DEBUG oslo_concurrency.processutils [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=86835) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:04:53 devstack sudo[86924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:04:53 devstack sudo[86924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:04:53 devstack sudo[86924]: pam_unix(sudo:session): session closed for user root Jul 21 02:04:53 devstack cinder-volume[86835]: DEBUG oslo_concurrency.processutils [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.249s {{(pid=86835) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:04:53 devstack cinder-volume[86835]: INFO cinder.volume.manager [None req-f4c84afc-6ab1-4a96-93eb-f6981e06d66d None None] Driver post RPC initialization completed successfully. Jul 21 02:04:58 devstack cinder-volume[86835]: DEBUG oslo_concurrency.lockutils [None req-cb2e0507-45bd-4fd7-a2e9-e6b7d71266e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86835) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:04:58 devstack cinder-volume[86835]: DEBUG oslo_concurrency.lockutils [None req-cb2e0507-45bd-4fd7-a2e9-e6b7d71266e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86835) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:04:58 devstack cinder-volume[86835]: DEBUG cinder.volume.drivers.quobyte [None req-cb2e0507-45bd-4fd7-a2e9-e6b7d71266e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=86835) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:04:58 devstack cinder-volume[86835]: DEBUG cinder.volume.drivers.quobyte [None req-cb2e0507-45bd-4fd7-a2e9-e6b7d71266e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=86835) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:04:58 devstack cinder-volume[86835]: DEBUG oslo_concurrency.lockutils [None req-cb2e0507-45bd-4fd7-a2e9-e6b7d71266e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86835) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:04:58 devstack cinder-volume[86835]: DEBUG oslo_concurrency.processutils [None req-cb2e0507-45bd-4fd7-a2e9-e6b7d71266e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=86835) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:04:58 devstack sudo[87184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:04:58 devstack sudo[87184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:04:58 devstack cinder-volume[86615]: INFO oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] Caught SIGTERM, stopping children Jul 21 02:04:58 devstack cinder-volume[86615]: DEBUG oslo_concurrency.lockutils [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] Acquiring lock "singleton_lock" {{(pid=86615) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 02:04:58 devstack cinder-volume[86615]: DEBUG oslo_concurrency.lockutils [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] Acquired lock "singleton_lock" {{(pid=86615) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 02:04:58 devstack cinder-volume[86615]: DEBUG oslo_concurrency.lockutils [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] Releasing lock "singleton_lock" {{(pid=86615) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 02:04:58 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] Stop services. {{(pid=86615) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 21 02:04:58 devstack cinder-volume[86615]: DEBUG oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] Killing children. {{(pid=86615) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 21 02:04:58 devstack cinder-volume[86615]: INFO oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] Waiting on 1 children to exit Jul 21 02:04:58 devstack sudo[87184]: pam_unix(sudo:session): session closed for user root Jul 21 02:04:58 devstack cinder-volume[86835]: DEBUG oslo_concurrency.processutils [None req-cb2e0507-45bd-4fd7-a2e9-e6b7d71266e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.592s {{(pid=86835) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:04:58 devstack cinder-volume[86835]: DEBUG cinder.manager [None req-cb2e0507-45bd-4fd7-a2e9-e6b7d71266e2 None None] Notifying Schedulers of capabilities ... {{(pid=86835) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:04:58 devstack cinder-volume[86835]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cb2e0507-45bd-4fd7-a2e9-e6b7d71266e2 None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Jul 21 02:04:58 devstack cinder-volume[86835]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cb2e0507-45bd-4fd7-a2e9-e6b7d71266e2 None None] Unable to connect to AMQP server on 192.168.122.80:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server [None req-cb2e0507-45bd-4fd7-a2e9-e6b7d71266e2 None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.80:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^ Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^ Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__ Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server method() Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1560, in _publish Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server self._producer.publish( Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server return _publish( Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server ^^^^^^^^^ Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server listener(*args) Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server raise error_for_code( Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 154, in cast Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server self.transport._send(self.target, msg_ctxt, msg, Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 794, in send Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 769, in _send Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1679, in fanout_send Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1509, in _ensure_publishing Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1131, in ensure Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.80:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Jul 21 02:04:59 devstack cinder-volume[86835]: ERROR oslo_messaging.rpc.server Jul 21 02:05:01 devstack cinder-volume[86835]: DEBUG oslo_concurrency.lockutils [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] Acquiring lock "singleton_lock" {{(pid=86835) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 02:05:01 devstack cinder-volume[86835]: DEBUG oslo_concurrency.lockutils [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] Acquired lock "singleton_lock" {{(pid=86835) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 02:05:01 devstack cinder-volume[86835]: DEBUG oslo_concurrency.lockutils [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] Releasing lock "singleton_lock" {{(pid=86835) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 02:05:01 devstack cinder-volume[86835]: WARNING amqp [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 21 02:05:01 devstack cinder-volume[86835]: WARNING amqp [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 21 02:05:01 devstack cinder-volume[86615]: INFO oslo_service.backend._eventlet.service [None req-2bd91758-20fa-4676-a8d2-791325360050 None None] Child 86835 exited with status 0 Jul 21 02:05:02 devstack cinder-volume[87247]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 21 02:05:02 devstack cinder-volume[87247]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 21 02:05:02 devstack cinder-volume[87247]: we strongly recommend against using it for new projects. Jul 21 02:05:02 devstack cinder-volume[87247]: If you are already using Eventlet, we recommend migrating to a different Jul 21 02:05:02 devstack cinder-volume[87247]: framework. For more detail see Jul 21 02:05:02 devstack cinder-volume[87247]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 21 02:05:02 devstack cinder-volume[87247]: import eventlet # noqa Jul 21 02:05:04 devstack cinder-volume[87247]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87247) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 02:05:04 devstack cinder-volume[87247]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87247) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 02:05:04 devstack cinder-volume[87247]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87247) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 02:05:05 devstack cinder-volume[87247]: INFO dbcounter [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] Registered counter for database cinder Jul 21 02:05:05 devstack cinder-volume[87247]: DEBUG oslo_db.sqlalchemy.engines [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87247) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG dbcounter [-] [87247] Writer thread running {{(pid=87247) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 02:05:06 devstack cinder-volume[87247]: INFO cinder.rpc [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 21 02:05:06 devstack cinder-volume[87247]: INFO cinder.rpc [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_db.sqlalchemy.engines [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87247) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 02:05:06 devstack cinder-volume[87247]: INFO cinder.volume.manager [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] Determined volume DB was empty at startup. Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG cinder.volume.manager [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87247) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 21 02:05:06 devstack cinder-volume[87247]: WARNING stevedore.named [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 21 02:05:06 devstack cinder-volume[87247]: WARNING castellan.key_manager [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 02:05:06 devstack cinder-volume[87247]: WARNING cinder.keymgr.conf_key_mgr [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 02:05:06 devstack cinder-volume[87247]: INFO cinder.volume.manager [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_db.sqlalchemy.engines [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87247) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 02:05:06 devstack cinder-volume[87247]: INFO oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] Starting 1 workers Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] Started child 87566 {{(pid=87247) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] Full set of CONF: {{(pid=87247) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] ******************************************************************************** {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] Configuration options gathered from: {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] ================================================================================ {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] allow_availability_zone_fallback = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] allow_compression_on_image_upload = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] allowed_direct_url_schemes = [] {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] api_rate_limit = True {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] auth_strategy = keystone {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87566]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_availability_zone = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_host = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_name = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_stats_polling_interval = 60 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backup_api_class = cinder.backup.api.API {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backup_name_template = backup-%s {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backup_use_same_host = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backup_use_temp_snapshot = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] chap_password = **** {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] chap_username = {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cinder_internal_tenant_project_id = be39213244aa4f9aaafdbaa630944738 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cinder_internal_tenant_user_id = a6c78acc4a5047548c4c5976a5ec5857 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cluster = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] compression_format = gzip {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] compute_api_class = cinder.compute.nova.API {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] config_dir = [] {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] config_source = [] {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] control_exchange = openstack {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] debug = True {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] default_availability_zone = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] default_group_type = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] default_volume_type = QuobyteHD {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] disk_geometry = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] driver_client_cert = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] driver_client_cert_key = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] driver_data_namespace = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] driver_ssl_cert_path = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] driver_ssl_cert_verify = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] driver_use_ssl = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] enable_new_services = True {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] enable_unsupported_driver = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] enabled_backends = ['QuobyteHD'] {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] enforce_multipath_for_image_xfer = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] filter_function = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] glance_api_insecure = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] glance_api_servers = ['http://192.168.122.80/image'] {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] glance_api_ssl_compression = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] glance_ca_certificates_file = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] glance_catalog_info = image:glance:publicURL {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] glance_certfile = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] glance_keyfile = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] glance_num_retries = 3 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] glance_request_timeout = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] goodness_function = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] graceful_shutdown_timeout = 5 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] group_api_class = cinder.group.api.API {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] host = devstack {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] image_compress_on_upload = True {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] image_conversion_address_space_limit = 1 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] image_conversion_cpu_limit = 60 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] image_conversion_disable = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] image_upload_use_cinder_backend = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] image_upload_use_internal_tenant = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] image_volume_cache_enabled = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] image_volume_cache_max_count = 0 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] image_volume_cache_max_size_gb = 0 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] init_host_max_objects_retrieval = 0 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] instance_format = [instance: %(uuid)s] {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] iscsi_target_flags = {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] iscsi_write_cache = on {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] iser_helper = tgtadm {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] iser_ip_address = 192.168.122.80 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] iser_port = 3260 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] log_color = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] log_config_append = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] log_dir = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] log_file = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] log_options = True {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] log_rotate_interval = 1 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] log_rotate_interval_type = days {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] log_rotation_type = none {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] max_age = 0 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] max_logfile_count = 30 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] max_logfile_size_mb = 200 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] max_over_subscription_ratio = 20.0 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] message_reap_interval = 86400 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] message_ttl = 2592000 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] migration_create_volume_timeout_secs = 300 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] monkey_patch = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] monkey_patch_modules = [] {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] my_ip = 192.168.122.80 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] no_snapshot_gb_quota = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] num_iser_scan_tries = 3 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] num_shell_tries = 3 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] num_volume_device_scan_tries = 3 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] nvmeof_conn_info_version = 1 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] nvmet_ns_id = 10 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] nvmet_port_id = 1 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] osapi_max_limit = 1000 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] osapi_volume_ext_list = [] {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] osapi_volume_listen = 0.0.0.0 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] osapi_volume_listen_port = 8776 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] osapi_volume_use_ssl = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] osapi_volume_workers = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] per_volume_size_limit = -1 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] periodic_fuzzy_delay = 60 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] periodic_interval = 60 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] project_id_regex = [0-9a-f\-]+ {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] public_endpoint = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] publish_errors = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] quota_backup_gigabytes = 1000 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] quota_backups = 10 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] quota_gigabytes = 1000 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] quota_groups = 10 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] quota_snapshots = 10 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] quota_volumes = 10 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] rate_limit_burst = 0 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] rate_limit_except_level = CRITICAL {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] rate_limit_interval = 0 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] reinit_driver_count = 3 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] replication_device = **** {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] report_discard_supported = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] report_interval = 120 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] reservation_clean_interval = 86400 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] reservation_expire = 86400 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] reserved_image_namespaces = [] {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] reserved_percentage = 0 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] rpc_response_timeout = 120 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] run_external_periodic_tasks = True {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] scst_target_driver = iscsi {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] scst_target_iqn_name = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] service_down_time = 720 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] shell_completion = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] snapshot_name_template = snapshot-%s {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] split_loggers = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] state_path = /opt/stack/data/cinder {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] storage_availability_zone = nova {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] storage_protocol = iSCSI {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] syslog_log_facility = LOG_USER {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] target_helper = lioadm {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] target_ip_address = 192.168.122.80 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] target_port = 3260 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] target_protocol = iscsi {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] target_secondary_ip_addresses = [] {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] trace_flags = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] transfer_api_class = cinder.transfer.api.API {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] transport_url = **** {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] until_refresh = 0 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] use_chap_auth = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] use_default_quota_class = True {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] use_journal = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] use_json = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] use_multipath_for_image_xfer = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] use_stderr = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] use_syslog = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] verify_glance_signatures = enabled {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] volume_api_class = cinder.volume.api.API {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] volume_backend_name = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] volume_clear = zero {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] volume_clear_ionice = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] volume_clear_size = 0 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] volume_copy_bps_limit = 0 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] volume_dd_blocksize = 1M {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] volume_name_template = volume-%s {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] volume_service_inithost_offload = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] volume_usage_audit_period = month {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] zoning_mode = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_concurrency.disable_process_locking = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] Starting volume driver QuobyteDriver (1.2) Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87566) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.auth_section = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.auth_type = password {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.auth_version = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.cache = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.certfile = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.delay_auth_decision = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.http_connect_timeout = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.include_service_catalog = True {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.insecure = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.interface = public {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.keyfile = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.memcache_password = {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.memcache_username = {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.region_name = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.service_token_roles_required = True {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.service_type = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.token_cache_time = 300 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.80/identity {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.backend = dogpile.cache.null {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.backend_argument = **** {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.backend_expiration_time = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.config_prefix = cache.oslo {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.debug_cache_backend = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.enable_retry_client = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.enable_socket_keepalive = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.enabled = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.expiration_time = 600 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.hashclient_retry_attempts = 2 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.memcache_dead_retry = 300 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.memcache_pool_maxsize = 10 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.memcache_sasl_enabled = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.password = **** {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.proxies = [] {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.redis_db = 0 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.redis_sentinel_service_name = mymaster {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.redis_server = localhost:6379 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.retry_attempts = 2 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.retry_delay = 0.0 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.socket_keepalive_count = 1 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.socket_keepalive_idle = 1 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.socket_keepalive_interval = 1 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.socket_timeout = 1.0 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.tls_allowed_ciphers = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.tls_cafile = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.tls_certfile = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.tls_enabled = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.tls_keyfile = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cache.username = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] coordination.backend_url = **** {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] database.asyncio_connection = **** {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] database.asyncio_slave_connection = **** {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] database.backend = sqlalchemy {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] database.connection = **** {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] database.connection_debug = 0 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] database.connection_parameters = {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] database.connection_recycle_time = 3600 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] database.connection_trace = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] database.db_inc_retry_interval = True {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] database.db_max_retries = 20 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] database.db_max_retry_interval = 10 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] database.db_retry_interval = 1 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] database.max_overflow = 50 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] database.max_pool_size = 5 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] database.max_retries = 10 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] database.mysql_wsrep_sync_wait = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] database.pool_timeout = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] database.retry_interval = 10 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] database.slave_connection = **** {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] database.sqlite_synchronous = True {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] database.synchronous_reader = True {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] database.use_db_reconnect = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] profiler.connection_string = messaging:// {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] profiler.enabled = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] profiler.es_doc_type = notification {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] profiler.es_scroll_size = 10000 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] profiler.es_scroll_time = 2m {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] profiler.filter_error_trace = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] profiler.hmac_keys = **** {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] profiler.sentinel_service_name = mymaster {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] profiler.socket_timeout = 0.1 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] profiler.trace_requests = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] profiler.trace_sqlalchemy = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] profiler_jaeger.process_tags = {} {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] profiler_jaeger.service_name_prefix = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] profiler_otlp.service_name_prefix = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_policy.enforce_new_defaults = True {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_policy.policy_default_rule = default {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_policy.policy_file = policy.yaml {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_policy.remote_timeout = 60.0 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] privsep_osbrick.group = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] privsep_osbrick.helper_command = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] privsep_osbrick.user = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cinder_sys_admin.group = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cinder_sys_admin.helper_command = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] cinder_sys_admin.user = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] service_user.auth_section = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] service_user.auth_type = password {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] service_user.cafile = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] service_user.certfile = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] service_user.collect_timing = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] service_user.insecure = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] service_user.keyfile = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] service_user.send_service_user_token = True {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] service_user.split_loggers = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] service_user.timeout = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] glance.auth_section = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] glance.auth_type = password {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] glance.certfile = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] glance.collect_timing = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] glance.insecure = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] glance.keyfile = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] glance.region_name = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] glance.split_loggers = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] glance.timeout = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.backend_availability_zone = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.chap_password = **** {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.chap_username = {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.disk_geometry = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.driver_client_cert = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.driver_client_cert_key = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.driver_data_namespace = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.driver_use_ssl = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.enable_unsupported_driver = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack quobyte-client[87567]: Reading configuration file: /etc/quobyte/client.cfg Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.extra_capabilities = {} {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.filter_function = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.goodness_function = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack quobyte-client[87567]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.iscsi_target_flags = {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.iscsi_write_cache = on {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.iser_helper = tgtadm {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.iser_ip_address = 192.168.122.80 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.iser_port = 3260 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.nas_host = {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.nas_login = admin {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.nas_mount_options = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87566) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 21 02:05:06 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.quobyte [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.nas_password = **** {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.quobyte [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.nas_private_key = {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.nas_share_path = {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] Running cmd (subprocess): mount.quobyte {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.nas_ssh_port = 22 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.num_shell_tries = 3 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.nvmet_port_id = 1 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.quobyte_client_cfg = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.quobyte_volume_url = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.replication_device = **** {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.report_discard_supported = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.reserved_percentage = 0 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.scst_target_driver = iscsi {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.scst_target_iqn_name = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.storage_protocol = iSCSI {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.target_helper = tgtadm {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.target_ip_address = 192.168.122.80 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.target_port = 3260 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.target_protocol = iscsi {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.trace_flags = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.unique_fqdn_network = True {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.use_chap_auth = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.volume_backend_name = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.volume_clear = zero {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.volume_clear_ionice = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.volume_clear_size = 0 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_reports.file_event_handler = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_reports.log_dir = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.backend_availability_zone = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.backend_host = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.chap_password = **** {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.chap_username = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.chiscsi_conf = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.disk_geometry = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.driver_client_cert = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.driver_client_cert_key = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.driver_data_namespace = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.driver_use_ssl = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.extra_capabilities = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.filter_function = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.goodness_function = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.iscsi_target_flags = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.iscsi_write_cache = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.iser_helper = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.iser_ip_address = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.iser_port = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.iser_target_prefix = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.nas_host = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.nas_login = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.nas_mount_options = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.nas_password = **** {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.nas_private_key = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.nas_share_path = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.nas_ssh_port = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.num_shell_tries = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.nvmet_ns_id = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.nvmet_port_id = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.replication_device = **** {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.report_discard_supported = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.reserved_percentage = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.scst_target_driver = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.storage_protocol = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.target_helper = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.target_ip_address = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.target_port = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.target_prefix = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.target_protocol = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.trace_flags = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.unique_fqdn_network = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.use_chap_auth = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.volume_clear = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.volume_clear_ionice = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.volume_clear_size = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] QuobyteHD.volumes_dir = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.ssl = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack sudo[87569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.ssl_version = {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack sudo[87569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_notifications.driver = [] {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_notifications.retry = -1 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] oslo_messaging_notifications.transport_url = **** {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] key_manager.fixed_key = **** {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] barbican.barbican_api_version = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] barbican.barbican_endpoint = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] barbican.barbican_endpoint_type = public {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] barbican.barbican_region_name = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] barbican.cafile = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] barbican.certfile = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] barbican.collect_timing = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] barbican.insecure = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] barbican.keyfile = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] barbican.number_of_retries = 60 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] barbican.retry_delay = 1 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] barbican.send_service_user_token = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] barbican.split_loggers = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] barbican.timeout = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] barbican.verify_ssl = True {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] barbican.verify_ssl_path = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] barbican_service_user.auth_section = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] barbican_service_user.auth_type = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] barbican_service_user.cafile = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] barbican_service_user.certfile = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] barbican_service_user.collect_timing = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] barbican_service_user.insecure = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] barbican_service_user.keyfile = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] barbican_service_user.split_loggers = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] barbican_service_user.timeout = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] vault.approle_role_id = **** {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] vault.approle_secret_id = **** {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] vault.auth_method = approle {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] vault.auth_path = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] vault.kv_mountpoint = secret {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] vault.kv_path = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] vault.kv_version = 2 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] vault.namespace = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] vault.root_token_id = **** {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] vault.ssl_ca_crt_file = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] vault.timeout = 60.0 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] vault.token_file = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] vault.token_role = None {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] vault.use_ssl = False {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 02:05:06 devstack cinder-volume[87247]: DEBUG oslo_service.backend._eventlet.service [None req-30b94f5b-cb13-441b-87cd-003007c0a5da None None] ******************************************************************************** {{(pid=87247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 21 02:05:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] CMD "mount.quobyte" returned: 1 in 0.072s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:05:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:05:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:05:06 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:05:06 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:05:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:05:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:05:07 devstack sudo[87569]: pam_unix(sudo:session): session closed for user root Jul 21 02:05:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.286s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:05:07 devstack cinder-volume[87566]: INFO cinder.volume.driver [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] Driver hasn't implemented _init_vendor_properties() Jul 21 02:05:07 devstack cinder-volume[87566]: DEBUG cinder.volume.driver [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87566) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 21 02:05:07 devstack cinder-volume[87566]: DEBUG oslo_db.sqlalchemy.engines [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87566) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 02:05:07 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writer thread running {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 02:05:07 devstack cinder-volume[87566]: DEBUG cinder.db.api [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] Building query based on filter {{(pid=87566) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 21 02:05:07 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87566) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 21 02:05:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:05:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:05:07 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:05:07 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:05:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:05:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:05:07 devstack cinder-volume[87566]: INFO cinder.keymgr.migration [None req-6b7c91a1-6e75-4d54-8db8-dc303869cfb7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 21 02:05:07 devstack sudo[87581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:05:07 devstack sudo[87581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:05:07 devstack sudo[87581]: pam_unix(sudo:session): session closed for user root Jul 21 02:05:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.234s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:05:07 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:05:07 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] Driver initialization completed successfully. Jul 21 02:05:07 devstack cinder-volume[87566]: INFO cinder.manager [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] Initiating service 3 cleanup Jul 21 02:05:07 devstack cinder-volume[87566]: INFO cinder.manager [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] Service 3 cleanup completed. Jul 21 02:05:07 devstack cinder-volume[87566]: DEBUG cinder.service [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] Creating RPC server for service cinder-volume {{(pid=87566) start /opt/stack/cinder/cinder/service.py:231}} Jul 21 02:05:07 devstack cinder-volume[87566]: DEBUG cinder.service [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87566) start /opt/stack/cinder/cinder/service.py:237}} Jul 21 02:05:07 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 21 02:05:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:05:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:05:07 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:05:07 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:05:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:05:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:05:07 devstack sudo[87594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:05:07 devstack sudo[87594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:05:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.264s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:05:07 devstack sudo[87594]: pam_unix(sudo:session): session closed for user root Jul 21 02:05:07 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-0ee1a7ad-d51f-4e82-a05a-8ea5b505e924 None None] Driver post RPC initialization completed successfully. Jul 21 02:05:16 devstack cinder-volume[87247]: DEBUG dbcounter [-] [87247] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87247) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:05:17 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=2 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:05:17 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:05:48 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager._thread_info {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:05:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread count: 6 {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 02:05:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread info: [<_MainThread(MainThread, started 135786703114368)>, , , , , ] {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 02:06:15 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:06:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] Flow 'volume_create_manager' (589d1837-6036-48b3-9694-7f66a0f7a6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:06:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f4cccdc-2496-41f6-b385-1855380dd405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:06:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f4cccdc-2496-41f6-b385-1855380dd405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-403520509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4230b0fc-d52c-4d7e-9b60-b1102041f44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42fe6a25a38c4cd59472c94d51d77af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:06:15Z,use_quota=True,user_id='055c4d66daa04b10a84e8816326696ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:06:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac088f0e-2b74-4224-9172-a56759e54ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:06:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac088f0e-2b74-4224-9172-a56759e54ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:06:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (896b1156-c6cf-4c0f-8261-aad67c403d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:06:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (896b1156-c6cf-4c0f-8261-aad67c403d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4230b0fc-d52c-4d7e-9b60-b1102041f44a', 'volume_name': 'volume-4230b0fc-d52c-4d7e-9b60-b1102041f44a', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:06:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a871d226-de96-41e0-92bf-440578ae7187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:06:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a871d226-de96-41e0-92bf-440578ae7187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:06:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af275ec1-49be-4ff2-a34e-4bc46ed32e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:06:15 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] Volume 4230b0fc-d52c-4d7e-9b60-b1102041f44a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4230b0fc-d52c-4d7e-9b60-b1102041f44a', 'volume_size': 1} Jul 21 02:06:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:06:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:06:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-403520509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4230b0fc-d52c-4d7e-9b60-b1102041f44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42fe6a25a38c4cd59472c94d51d77af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:06:15Z,use_quota=True,user_id='055c4d66daa04b10a84e8816326696ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:06:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] Creating volume 4230b0fc-d52c-4d7e-9b60-b1102041f44a {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:06:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:06:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:06:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:06:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:06:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:06:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:06:15 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:06:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4230b0fc-d52c-4d7e-9b60-b1102041f44a 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:06:15 devstack sudo[88232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4230b0fc-d52c-4d7e-9b60-b1102041f44a 1073741824 Jul 21 02:06:15 devstack sudo[88232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:06:16 devstack sudo[88232]: pam_unix(sudo:session): session closed for user root Jul 21 02:06:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4230b0fc-d52c-4d7e-9b60-b1102041f44a 1073741824" returned: 0 in 1.224s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:06:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4230b0fc-d52c-4d7e-9b60-b1102041f44a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:06:16 devstack sudo[88576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4230b0fc-d52c-4d7e-9b60-b1102041f44a Jul 21 02:06:16 devstack sudo[88576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:06:16 devstack sudo[88576]: pam_unix(sudo:session): session closed for user root Jul 21 02:06:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4230b0fc-d52c-4d7e-9b60-b1102041f44a" returned: 0 in 0.264s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:06:16 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:06:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:06:17 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af275ec1-49be-4ff2-a34e-4bc46ed32e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4230b0fc-d52c-4d7e-9b60-b1102041f44a', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:06:17 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5919d615-5b1c-444b-bd38-7ae6248090b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:06:17 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] Volume volume-4230b0fc-d52c-4d7e-9b60-b1102041f44a (4230b0fc-d52c-4d7e-9b60-b1102041f44a): created successfully Jul 21 02:06:17 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5919d615-5b1c-444b-bd38-7ae6248090b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:06:17 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] Flow 'volume_create_manager' (589d1837-6036-48b3-9694-7f66a0f7a6d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:06:17 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-2c6f3f71-d364-4f4d-9ffa-f9263fcdc291 tempest-DeleteServersTestJSON-1609659145 None] Created volume successfully. Jul 21 02:06:21 devstack cinder-volume[87566]: WARNING py.warnings [req-48cdca8e-4e76-43a5-a671-9503e8ebe3d6 req-468743a5-b7d0-4545-b755-8a376a05a6a4 tempest-DeleteServersTestJSON-1609659145 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 21 02:06:21 devstack cinder-volume[87566]: .first() Jul 21 02:06:21 devstack cinder-volume[87566]: Jul 21 02:06:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-48cdca8e-4e76-43a5-a671-9503e8ebe3d6 req-468743a5-b7d0-4545-b755-8a376a05a6a4 tempest-DeleteServersTestJSON-1609659145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:06:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-48cdca8e-4e76-43a5-a671-9503e8ebe3d6 req-468743a5-b7d0-4545-b755-8a376a05a6a4 tempest-DeleteServersTestJSON-1609659145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:06:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-48cdca8e-4e76-43a5-a671-9503e8ebe3d6 req-468743a5-b7d0-4545-b755-8a376a05a6a4 tempest-DeleteServersTestJSON-1609659145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:06:21 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-48cdca8e-4e76-43a5-a671-9503e8ebe3d6 req-468743a5-b7d0-4545-b755-8a376a05a6a4 tempest-DeleteServersTestJSON-1609659145 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea', 'name': 'volume-4230b0fc-d52c-4d7e-9b60-b1102041f44a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'db9af60c-823b-4df6-8ff7-41df041e538a', 'enforce_multipath': True} {{(pid=87566) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 02:06:21 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-48cdca8e-4e76-43a5-a671-9503e8ebe3d6 req-468743a5-b7d0-4545-b755-8a376a05a6a4 tempest-DeleteServersTestJSON-1609659145 None] attachment_update completed successfully. Jul 21 02:06:24 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-a0de92d1-70f6-4930-b976-a2c5ac6b15de req-fbfced81-312c-46cf-8597-d1eddeda5e52 tempest-DeleteServersTestJSON-1609659145 None] Terminate volume connection completed successfully. Jul 21 02:06:24 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-a0de92d1-70f6-4930-b976-a2c5ac6b15de req-fbfced81-312c-46cf-8597-d1eddeda5e52 tempest-DeleteServersTestJSON-1609659145 None] Deleting attachment db9af60c-823b-4df6-8ff7-41df041e538a. {{(pid=87566) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 02:06:26 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-38123f56-ff67-4237-b5f8-b87a374e889f tempest-DeleteServersTestJSON-1609659145 None] Acquiring lock "cinder-4230b0fc-d52c-4d7e-9b60-b1102041f44a-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:06:26 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-38123f56-ff67-4237-b5f8-b87a374e889f tempest-DeleteServersTestJSON-1609659145 None] Lock "cinder-4230b0fc-d52c-4d7e-9b60-b1102041f44a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:06:26 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-38123f56-ff67-4237-b5f8-b87a374e889f tempest-DeleteServersTestJSON-1609659145 None] Acquiring lock "cinder-quobyte-4230b0fc-d52c-4d7e-9b60-b1102041f44a" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:06:26 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-38123f56-ff67-4237-b5f8-b87a374e889f tempest-DeleteServersTestJSON-1609659145 None] Lock "cinder-quobyte-4230b0fc-d52c-4d7e-9b60-b1102041f44a" acquired by "delete_volume" :: waited 0.025s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:06:26 devstack cinder-volume[87566]: INFO oslo.privsep.daemon [None req-38123f56-ff67-4237-b5f8-b87a374e889f tempest-DeleteServersTestJSON-1609659145 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp6m02e4d2/privsep.sock'] Jul 21 02:06:26 devstack sudo[89073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp6m02e4d2/privsep.sock Jul 21 02:06:26 devstack sudo[89073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:06:27 devstack cinder-volume[87566]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 21 02:06:27 devstack cinder-volume[87566]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 21 02:06:27 devstack cinder-volume[87566]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 21 02:06:27 devstack cinder-volume[87566]: WARNING oslo.privsep.daemon [-] privsep log: Jul 21 02:06:27 devstack cinder-volume[87566]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 21 02:06:27 devstack cinder-volume[87566]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 21 02:06:27 devstack cinder-volume[87566]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 21 02:06:27 devstack cinder-volume[87566]: WARNING oslo.privsep.daemon [-] privsep log: Jul 21 02:06:27 devstack cinder-volume[87566]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 21 02:06:27 devstack sudo[89073]: pam_unix(sudo:session): session closed for user root Jul 21 02:06:27 devstack cinder-volume[87566]: INFO oslo.privsep.daemon [None req-38123f56-ff67-4237-b5f8-b87a374e889f tempest-DeleteServersTestJSON-1609659145 None] Spawned new privsep daemon via rootwrap Jul 21 02:06:27 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [None req-38123f56-ff67-4237-b5f8-b87a374e889f tempest-DeleteServersTestJSON-1609659145 None] Accepted privsep connection to /tmp/tmp6m02e4d2/privsep.sock {{(pid=87566) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 21 02:06:27 devstack cinder-volume[87566]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 21 02:06:27 devstack cinder-volume[87566]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 21 02:06:27 devstack cinder-volume[87566]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 21 02:06:27 devstack cinder-volume[87566]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89104 Jul 21 02:06:27 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d61697a-a276-487b-8798-0b7dfbfca4b5]: (2,) {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:06:27 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4abaf43-bce1-412e-8096-7f196613a57c]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:06:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-38123f56-ff67-4237-b5f8-b87a374e889f tempest-DeleteServersTestJSON-1609659145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4230b0fc-d52c-4d7e-9b60-b1102041f44a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:06:27 devstack sudo[89106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4230b0fc-d52c-4d7e-9b60-b1102041f44a Jul 21 02:06:27 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:06:27 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root Jul 21 02:06:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-38123f56-ff67-4237-b5f8-b87a374e889f tempest-DeleteServersTestJSON-1609659145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4230b0fc-d52c-4d7e-9b60-b1102041f44a" returned: 0 in 0.390s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:06:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-38123f56-ff67-4237-b5f8-b87a374e889f tempest-DeleteServersTestJSON-1609659145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4230b0fc-d52c-4d7e-9b60-b1102041f44a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:06:27 devstack sudo[89111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4230b0fc-d52c-4d7e-9b60-b1102041f44a Jul 21 02:06:27 devstack sudo[89111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:06:28 devstack sudo[89111]: pam_unix(sudo:session): session closed for user root Jul 21 02:06:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-38123f56-ff67-4237-b5f8-b87a374e889f tempest-DeleteServersTestJSON-1609659145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4230b0fc-d52c-4d7e-9b60-b1102041f44a" returned: 0 in 0.283s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:06:28 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-38123f56-ff67-4237-b5f8-b87a374e889f tempest-DeleteServersTestJSON-1609659145 None] Lock "cinder-quobyte-4230b0fc-d52c-4d7e-9b60-b1102041f44a" released by "delete_volume" :: held 1.912s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:06:28 devstack cinder-volume[87566]: WARNING cinder.quota [None req-38123f56-ff67-4237-b5f8-b87a374e889f tempest-DeleteServersTestJSON-1609659145 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 21 02:06:28 devstack cinder-volume[87566]: WARNING cinder.quota [None req-38123f56-ff67-4237-b5f8-b87a374e889f tempest-DeleteServersTestJSON-1609659145 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 21 02:06:28 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-38123f56-ff67-4237-b5f8-b87a374e889f tempest-DeleteServersTestJSON-1609659145 None] Created reservations ['a2afb8b7-5a05-4487-905f-f8558b2030a6', 'e0625640-00f4-4b13-8c11-6be42a274776', '274a2ace-dbff-490f-987b-32e9b06000f0', '8aa44292-a8af-4a90-a2ca-b945a242450a'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:06:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-38123f56-ff67-4237-b5f8-b87a374e889f tempest-DeleteServersTestJSON-1609659145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:06:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-38123f56-ff67-4237-b5f8-b87a374e889f tempest-DeleteServersTestJSON-1609659145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:06:28 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-38123f56-ff67-4237-b5f8-b87a374e889f tempest-DeleteServersTestJSON-1609659145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:06:28 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-38123f56-ff67-4237-b5f8-b87a374e889f tempest-DeleteServersTestJSON-1609659145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:06:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-38123f56-ff67-4237-b5f8-b87a374e889f tempest-DeleteServersTestJSON-1609659145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:06:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-38123f56-ff67-4237-b5f8-b87a374e889f tempest-DeleteServersTestJSON-1609659145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:06:28 devstack sudo[89114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:06:28 devstack sudo[89114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:06:28 devstack sudo[89114]: pam_unix(sudo:session): session closed for user root Jul 21 02:06:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-38123f56-ff67-4237-b5f8-b87a374e889f tempest-DeleteServersTestJSON-1609659145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.306s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:06:28 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-38123f56-ff67-4237-b5f8-b87a374e889f tempest-DeleteServersTestJSON-1609659145 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:06:28 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-38123f56-ff67-4237-b5f8-b87a374e889f tempest-DeleteServersTestJSON-1609659145 None] Deleted volume successfully. Jul 21 02:06:28 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-38123f56-ff67-4237-b5f8-b87a374e889f tempest-DeleteServersTestJSON-1609659145 None] Lock "cinder-4230b0fc-d52c-4d7e-9b60-b1102041f44a-delete_volume" released by "delete_volume" :: held 2.520s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:06:30 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:06:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] Flow 'volume_create_manager' (1c4610f7-da51-4d59-984d-c0c29892c56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:06:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6510f71e-aab4-4beb-b780-be035b80c48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:06:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6510f71e-aab4-4beb-b780-be035b80c48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-832538229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18335f31-785d-40d8-a1c2-e08235833720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51866674674f461e9faf35a721dccf24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:06:30Z,use_quota=True,user_id='7c16531364884cf9af97821ee6a57b95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:06:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31332cac-9413-48a2-a05d-6eb9c4ed01d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:06:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31332cac-9413-48a2-a05d-6eb9c4ed01d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:06:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d374097b-0a4d-49f3-b4dc-febf3218ff4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:06:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d374097b-0a4d-49f3-b4dc-febf3218ff4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18335f31-785d-40d8-a1c2-e08235833720', 'volume_name': 'volume-18335f31-785d-40d8-a1c2-e08235833720', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:06:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ed3ade3-72e3-4b60-88c6-1e51735c1d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:06:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ed3ade3-72e3-4b60-88c6-1e51735c1d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:06:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d76a66-6b22-4f04-9893-465b8f32a140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:06:30 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] Volume 18335f31-785d-40d8-a1c2-e08235833720: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18335f31-785d-40d8-a1c2-e08235833720', 'volume_size': 1} Jul 21 02:06:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:06:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:06:30 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-832538229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18335f31-785d-40d8-a1c2-e08235833720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51866674674f461e9faf35a721dccf24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:06:30Z,use_quota=True,user_id='7c16531364884cf9af97821ee6a57b95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:06:30 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] Creating volume 18335f31-785d-40d8-a1c2-e08235833720 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:06:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:06:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:06:30 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:06:30 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:06:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:06:30 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:06:30 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:06:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-18335f31-785d-40d8-a1c2-e08235833720 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:06:30 devstack sudo[89120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-18335f31-785d-40d8-a1c2-e08235833720 1073741824 Jul 21 02:06:30 devstack sudo[89120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:06:30 devstack sudo[89120]: pam_unix(sudo:session): session closed for user root Jul 21 02:06:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-18335f31-785d-40d8-a1c2-e08235833720 1073741824" returned: 0 in 0.550s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:06:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-18335f31-785d-40d8-a1c2-e08235833720 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:06:30 devstack sudo[89127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-18335f31-785d-40d8-a1c2-e08235833720 Jul 21 02:06:30 devstack sudo[89127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:06:31 devstack sudo[89127]: pam_unix(sudo:session): session closed for user root Jul 21 02:06:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-18335f31-785d-40d8-a1c2-e08235833720" returned: 0 in 0.287s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:06:31 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:06:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:06:31 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d76a66-6b22-4f04-9893-465b8f32a140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18335f31-785d-40d8-a1c2-e08235833720', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:06:31 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f5b0fa-117c-44e7-b497-2202ca25b58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:06:31 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] Volume volume-18335f31-785d-40d8-a1c2-e08235833720 (18335f31-785d-40d8-a1c2-e08235833720): created successfully Jul 21 02:06:31 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f5b0fa-117c-44e7-b497-2202ca25b58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:06:31 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] Flow 'volume_create_manager' (1c4610f7-da51-4d59-984d-c0c29892c56a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:06:31 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-98e362c0-65e7-443b-98eb-652606dce84e tempest-AttachVolumeShelveTestJSON-1918775869 None] Created volume successfully. Jul 21 02:06:41 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=17,cinder:INSERT=4,cinder:UPDATE=15 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:06:41 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:UPDATE=16,cinder:SELECT=16,cinder:DELETE=3,cinder:INSERT=2 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:06:48 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:06:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:06:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:06:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:06:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:06:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:06:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:06:48 devstack sudo[89215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:06:48 devstack sudo[89215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:06:49 devstack sudo[89215]: pam_unix(sudo:session): session closed for user root Jul 21 02:06:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.526s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:06:49 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:06:49 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager._thread_info {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:06:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread count: 8 {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 02:06:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread info: [<_MainThread(MainThread, started 135786703114368)>, , , , , , , ] {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 02:06:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-e7abfd25-0a10-4fd1-88f3-299dd73742e6 req-41d54376-44d5-497c-95d0-860343dfe232 tempest-AttachVolumeShelveTestJSON-1918775869 None] No connector for attachment 9140cb70-4540-4489-a5ce-3febbbc3c715; skipping storage backend terminate_connection call. {{(pid=87566) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 21 02:06:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-e7abfd25-0a10-4fd1-88f3-299dd73742e6 req-41d54376-44d5-497c-95d0-860343dfe232 tempest-AttachVolumeShelveTestJSON-1918775869 None] Deleting attachment 9140cb70-4540-4489-a5ce-3febbbc3c715. {{(pid=87566) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 02:06:55 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:06:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] Flow 'volume_create_manager' (598ad1f1-12e8-49b6-a778-902481b99380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:06:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f57faa-140f-4d0a-8c74-b6b551480131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:06:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f57faa-140f-4d0a-8c74-b6b551480131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-405239867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28b68324-4639-47fd-be60-96a529fa00a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58af1fe187e14a6ba6b7ef769fd5c37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:06:55Z,use_quota=True,user_id='8ddc3f32c63f43f0b1f2f5412026fd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:06:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e07d341c-d37a-4bab-b0e2-5cec643210fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:06:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e07d341c-d37a-4bab-b0e2-5cec643210fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:06:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5942aded-da9d-4e88-b1fa-9a33f5d8038b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:06:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5942aded-da9d-4e88-b1fa-9a33f5d8038b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28b68324-4639-47fd-be60-96a529fa00a0', 'volume_name': 'volume-28b68324-4639-47fd-be60-96a529fa00a0', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:06:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36507be5-dc81-49fe-9087-3a25a8f8c106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:06:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36507be5-dc81-49fe-9087-3a25a8f8c106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:06:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce58b46-67bf-4ef7-aed6-b94d4b055c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:06:55 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] Volume 28b68324-4639-47fd-be60-96a529fa00a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28b68324-4639-47fd-be60-96a529fa00a0', 'volume_size': 1} Jul 21 02:06:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:06:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:06:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-405239867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28b68324-4639-47fd-be60-96a529fa00a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58af1fe187e14a6ba6b7ef769fd5c37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:06:55Z,use_quota=True,user_id='8ddc3f32c63f43f0b1f2f5412026fd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:06:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] Creating volume 28b68324-4639-47fd-be60-96a529fa00a0 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:06:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:06:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:06:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:06:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:06:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:06:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:06:55 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:06:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-28b68324-4639-47fd-be60-96a529fa00a0 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:06:55 devstack sudo[89229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-28b68324-4639-47fd-be60-96a529fa00a0 1073741824 Jul 21 02:06:55 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:06:55 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root Jul 21 02:06:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-28b68324-4639-47fd-be60-96a529fa00a0 1073741824" returned: 0 in 0.753s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:06:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-28b68324-4639-47fd-be60-96a529fa00a0 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:06:56 devstack sudo[89236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-28b68324-4639-47fd-be60-96a529fa00a0 Jul 21 02:06:56 devstack sudo[89236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:06:56 devstack sudo[89236]: pam_unix(sudo:session): session closed for user root Jul 21 02:06:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-28b68324-4639-47fd-be60-96a529fa00a0" returned: 0 in 0.327s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:06:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:06:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:06:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce58b46-67bf-4ef7-aed6-b94d4b055c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28b68324-4639-47fd-be60-96a529fa00a0', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:06:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ff3a53e-6fa3-4782-aee3-fa78ddeeb269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:06:56 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] Volume volume-28b68324-4639-47fd-be60-96a529fa00a0 (28b68324-4639-47fd-be60-96a529fa00a0): created successfully Jul 21 02:06:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ff3a53e-6fa3-4782-aee3-fa78ddeeb269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:06:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] Flow 'volume_create_manager' (598ad1f1-12e8-49b6-a778-902481b99380) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:06:56 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-eb3b59fc-411a-4008-a25f-025a073b87f6 tempest-ServerActionsTestOtherA-1081708656 None] Created volume successfully. Jul 21 02:07:06 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:07:06 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:07:07 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:07:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] Flow 'volume_create_manager' (099f4950-b11e-41c9-b9cb-f32bf6b7f54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:07:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6a394e-b4c4-4efa-ae68-6681f7d4c5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:07:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6a394e-b4c4-4efa-ae68-6681f7d4c5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1374950724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e483c3-5db9-4aef-b543-fbe9c6072fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42b6fd5713f04151a21b01d28b1a5d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:07:07Z,use_quota=True,user_id='dc451c7bba6044e496b182c655bc1a47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:07:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2d13cfe-a2e6-499c-b87e-bde7809eff46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:07:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2d13cfe-a2e6-499c-b87e-bde7809eff46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:07:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ceff80-5056-4276-856c-95563bacc853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:07:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ceff80-5056-4276-856c-95563bacc853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13e483c3-5db9-4aef-b543-fbe9c6072fe4', 'volume_name': 'volume-13e483c3-5db9-4aef-b543-fbe9c6072fe4', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:07:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e1aef1-2c31-4ad0-935b-da4c7dc55a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:07:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e1aef1-2c31-4ad0-935b-da4c7dc55a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:07:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef3d20cc-0e7d-41b1-92b7-bd0ecf5e9d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:07:07 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] Volume 13e483c3-5db9-4aef-b543-fbe9c6072fe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13e483c3-5db9-4aef-b543-fbe9c6072fe4', 'volume_size': 1} Jul 21 02:07:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:07:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:07:07 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1374950724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e483c3-5db9-4aef-b543-fbe9c6072fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42b6fd5713f04151a21b01d28b1a5d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:07:07Z,use_quota=True,user_id='dc451c7bba6044e496b182c655bc1a47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:07:07 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] Creating volume 13e483c3-5db9-4aef-b543-fbe9c6072fe4 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:07:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:07:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:07:07 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:07:07 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:07:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:07:07 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:07:07 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:07:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13e483c3-5db9-4aef-b543-fbe9c6072fe4 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:07:07 devstack sudo[89257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13e483c3-5db9-4aef-b543-fbe9c6072fe4 1073741824 Jul 21 02:07:07 devstack sudo[89257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:07:08 devstack sudo[89257]: pam_unix(sudo:session): session closed for user root Jul 21 02:07:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13e483c3-5db9-4aef-b543-fbe9c6072fe4 1073741824" returned: 0 in 0.720s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:07:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13e483c3-5db9-4aef-b543-fbe9c6072fe4 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:07:08 devstack sudo[89267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13e483c3-5db9-4aef-b543-fbe9c6072fe4 Jul 21 02:07:08 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:07:08 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root Jul 21 02:07:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13e483c3-5db9-4aef-b543-fbe9c6072fe4" returned: 0 in 0.555s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:07:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:07:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:07:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef3d20cc-0e7d-41b1-92b7-bd0ecf5e9d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13e483c3-5db9-4aef-b543-fbe9c6072fe4', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:07:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a55be94-c7c5-49a3-93c2-9f0fff065e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:07:08 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] Volume volume-13e483c3-5db9-4aef-b543-fbe9c6072fe4 (13e483c3-5db9-4aef-b543-fbe9c6072fe4): created successfully Jul 21 02:07:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a55be94-c7c5-49a3-93c2-9f0fff065e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:07:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] Flow 'volume_create_manager' (099f4950-b11e-41c9-b9cb-f32bf6b7f54d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:07:08 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-7b292f9c-d97d-48d0-86a3-8febc500d499 tempest-TaggedAttachmentsTest-673283936 None] Created volume successfully. Jul 21 02:07:18 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=4,cinder:UPDATE=4 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:07:18 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:07:31 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:07:31 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] Flow 'volume_create_manager' (80ce6a2a-aa9f-4f75-aef2-f420ccd3b226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:07:31 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9eed4b6-06cd-4384-8846-a6b3672f4205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:07:31 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9eed4b6-06cd-4384-8846-a6b3672f4205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-651734225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09662144-2afa-4d80-8aee-20294944673c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6be447cbfbc34d6baa3947f6586826aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:07:32Z,use_quota=True,user_id='dc70f34dde2342efb5e46f4ca9a93933',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:07:31 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49324a71-2c73-4342-8e71-8754ce887b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:07:31 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49324a71-2c73-4342-8e71-8754ce887b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:07:31 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3af4131d-6e31-47cf-b085-a2a07380b178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:07:31 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3af4131d-6e31-47cf-b085-a2a07380b178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09662144-2afa-4d80-8aee-20294944673c', 'volume_name': 'volume-09662144-2afa-4d80-8aee-20294944673c', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:07:31 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1badc88-a8a6-4530-8b8b-c498dcb7d5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:07:31 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1badc88-a8a6-4530-8b8b-c498dcb7d5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:07:31 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f2b27bb-66e8-47c4-a2d3-db6ec1674730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:07:31 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] Volume 09662144-2afa-4d80-8aee-20294944673c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09662144-2afa-4d80-8aee-20294944673c', 'volume_size': 1} Jul 21 02:07:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:07:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:07:31 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-651734225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09662144-2afa-4d80-8aee-20294944673c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6be447cbfbc34d6baa3947f6586826aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:07:32Z,use_quota=True,user_id='dc70f34dde2342efb5e46f4ca9a93933',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:07:31 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] Creating volume 09662144-2afa-4d80-8aee-20294944673c {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:07:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:07:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:07:31 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:07:31 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:07:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:07:31 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:07:31 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:07:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-09662144-2afa-4d80-8aee-20294944673c 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:07:31 devstack sudo[89628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-09662144-2afa-4d80-8aee-20294944673c 1073741824 Jul 21 02:07:31 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:07:32 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root Jul 21 02:07:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-09662144-2afa-4d80-8aee-20294944673c 1073741824" returned: 0 in 0.758s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:07:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-09662144-2afa-4d80-8aee-20294944673c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:07:32 devstack sudo[89641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-09662144-2afa-4d80-8aee-20294944673c Jul 21 02:07:32 devstack sudo[89641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:07:33 devstack sudo[89641]: pam_unix(sudo:session): session closed for user root Jul 21 02:07:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-09662144-2afa-4d80-8aee-20294944673c" returned: 0 in 0.379s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:07:33 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:07:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:07:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f2b27bb-66e8-47c4-a2d3-db6ec1674730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09662144-2afa-4d80-8aee-20294944673c', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:07:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8dd739d-cd69-49ef-9f46-a9f3c48af25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:07:33 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] Volume volume-09662144-2afa-4d80-8aee-20294944673c (09662144-2afa-4d80-8aee-20294944673c): created successfully Jul 21 02:07:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8dd739d-cd69-49ef-9f46-a9f3c48af25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:07:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] Flow 'volume_create_manager' (80ce6a2a-aa9f-4f75-aef2-f420ccd3b226) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:07:33 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-303e3326-b0b4-43b7-bb00-9884387a33d1 tempest-VolumesAdminNegativeTest-1551412292 None] Created volume successfully. Jul 21 02:07:34 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-96fdff71-a10c-4f74-8b74-49af5b4b78db tempest-VolumesAdminNegativeTest-1551412292 None] Acquiring lock "cinder-09662144-2afa-4d80-8aee-20294944673c-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:07:34 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-96fdff71-a10c-4f74-8b74-49af5b4b78db tempest-VolumesAdminNegativeTest-1551412292 None] Lock "cinder-09662144-2afa-4d80-8aee-20294944673c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:07:34 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-96fdff71-a10c-4f74-8b74-49af5b4b78db tempest-VolumesAdminNegativeTest-1551412292 None] Acquiring lock "cinder-quobyte-09662144-2afa-4d80-8aee-20294944673c" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:07:34 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-96fdff71-a10c-4f74-8b74-49af5b4b78db tempest-VolumesAdminNegativeTest-1551412292 None] Lock "cinder-quobyte-09662144-2afa-4d80-8aee-20294944673c" acquired by "delete_volume" :: waited 0.024s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:07:34 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf93923-d093-4609-8c86-bd8c09f59adc]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:07:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-96fdff71-a10c-4f74-8b74-49af5b4b78db tempest-VolumesAdminNegativeTest-1551412292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-09662144-2afa-4d80-8aee-20294944673c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:07:34 devstack sudo[89644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-09662144-2afa-4d80-8aee-20294944673c Jul 21 02:07:34 devstack sudo[89644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:07:35 devstack sudo[89644]: pam_unix(sudo:session): session closed for user root Jul 21 02:07:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-96fdff71-a10c-4f74-8b74-49af5b4b78db tempest-VolumesAdminNegativeTest-1551412292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-09662144-2afa-4d80-8aee-20294944673c" returned: 0 in 0.739s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:07:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-96fdff71-a10c-4f74-8b74-49af5b4b78db tempest-VolumesAdminNegativeTest-1551412292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-09662144-2afa-4d80-8aee-20294944673c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:07:35 devstack sudo[89651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-09662144-2afa-4d80-8aee-20294944673c Jul 21 02:07:35 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:07:35 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root Jul 21 02:07:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-96fdff71-a10c-4f74-8b74-49af5b4b78db tempest-VolumesAdminNegativeTest-1551412292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-09662144-2afa-4d80-8aee-20294944673c" returned: 0 in 0.593s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:07:35 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-96fdff71-a10c-4f74-8b74-49af5b4b78db tempest-VolumesAdminNegativeTest-1551412292 None] Lock "cinder-quobyte-09662144-2afa-4d80-8aee-20294944673c" released by "delete_volume" :: held 1.402s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:07:35 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-96fdff71-a10c-4f74-8b74-49af5b4b78db tempest-VolumesAdminNegativeTest-1551412292 None] Created reservations ['89c1b79c-4ff9-4987-8295-3253bac4333e', '50b6a872-66d9-4c8f-b7e4-e6d058e2b197', 'd57b2a4a-0ecc-4fe6-830c-730caf399c09', 'fb521844-2479-45d6-9c07-caac2115cb99'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:07:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-96fdff71-a10c-4f74-8b74-49af5b4b78db tempest-VolumesAdminNegativeTest-1551412292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:07:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-96fdff71-a10c-4f74-8b74-49af5b4b78db tempest-VolumesAdminNegativeTest-1551412292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:07:36 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-96fdff71-a10c-4f74-8b74-49af5b4b78db tempest-VolumesAdminNegativeTest-1551412292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:07:36 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-96fdff71-a10c-4f74-8b74-49af5b4b78db tempest-VolumesAdminNegativeTest-1551412292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:07:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-96fdff71-a10c-4f74-8b74-49af5b4b78db tempest-VolumesAdminNegativeTest-1551412292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:07:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-96fdff71-a10c-4f74-8b74-49af5b4b78db tempest-VolumesAdminNegativeTest-1551412292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:07:36 devstack sudo[89656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:07:36 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:07:36 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root Jul 21 02:07:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-96fdff71-a10c-4f74-8b74-49af5b4b78db tempest-VolumesAdminNegativeTest-1551412292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.487s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:07:36 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-96fdff71-a10c-4f74-8b74-49af5b4b78db tempest-VolumesAdminNegativeTest-1551412292 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:07:36 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-96fdff71-a10c-4f74-8b74-49af5b4b78db tempest-VolumesAdminNegativeTest-1551412292 None] Deleted volume successfully. Jul 21 02:07:36 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-96fdff71-a10c-4f74-8b74-49af5b4b78db tempest-VolumesAdminNegativeTest-1551412292 None] Lock "cinder-09662144-2afa-4d80-8aee-20294944673c-delete_volume" released by "delete_volume" :: held 2.295s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:07:46 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:UPDATE=14,cinder:SELECT=6,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:07:46 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=8,cinder:INSERT=4,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:07:48 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:07:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:07:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:07:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:07:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:07:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:07:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:07:48 devstack sudo[89778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:07:48 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:07:49 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root Jul 21 02:07:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.263s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:07:49 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:07:59 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a435d1b8-603c-4e33-af81-18b5987471ad tempest-AttachVolumeShelveTestJSON-1918775869 None] Acquiring lock "cinder-18335f31-785d-40d8-a1c2-e08235833720-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:08:00 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a435d1b8-603c-4e33-af81-18b5987471ad tempest-AttachVolumeShelveTestJSON-1918775869 None] Lock "cinder-18335f31-785d-40d8-a1c2-e08235833720-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:08:00 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a435d1b8-603c-4e33-af81-18b5987471ad tempest-AttachVolumeShelveTestJSON-1918775869 None] Acquiring lock "cinder-quobyte-18335f31-785d-40d8-a1c2-e08235833720" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:08:00 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a435d1b8-603c-4e33-af81-18b5987471ad tempest-AttachVolumeShelveTestJSON-1918775869 None] Lock "cinder-quobyte-18335f31-785d-40d8-a1c2-e08235833720" acquired by "delete_volume" :: waited 0.020s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:08:00 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ed2755-0afd-4e52-8023-7b8a7d3525be]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:08:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a435d1b8-603c-4e33-af81-18b5987471ad tempest-AttachVolumeShelveTestJSON-1918775869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-18335f31-785d-40d8-a1c2-e08235833720 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:08:00 devstack sudo[89823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-18335f31-785d-40d8-a1c2-e08235833720 Jul 21 02:08:00 devstack sudo[89823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:08:00 devstack sudo[89823]: pam_unix(sudo:session): session closed for user root Jul 21 02:08:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a435d1b8-603c-4e33-af81-18b5987471ad tempest-AttachVolumeShelveTestJSON-1918775869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-18335f31-785d-40d8-a1c2-e08235833720" returned: 0 in 0.542s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:08:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a435d1b8-603c-4e33-af81-18b5987471ad tempest-AttachVolumeShelveTestJSON-1918775869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-18335f31-785d-40d8-a1c2-e08235833720 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:08:00 devstack sudo[89830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-18335f31-785d-40d8-a1c2-e08235833720 Jul 21 02:08:00 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:08:00 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root Jul 21 02:08:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a435d1b8-603c-4e33-af81-18b5987471ad tempest-AttachVolumeShelveTestJSON-1918775869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-18335f31-785d-40d8-a1c2-e08235833720" returned: 0 in 0.327s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:08:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a435d1b8-603c-4e33-af81-18b5987471ad tempest-AttachVolumeShelveTestJSON-1918775869 None] Lock "cinder-quobyte-18335f31-785d-40d8-a1c2-e08235833720" released by "delete_volume" :: held 0.914s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:08:01 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-a435d1b8-603c-4e33-af81-18b5987471ad tempest-AttachVolumeShelveTestJSON-1918775869 None] Created reservations ['a308a0ec-c9af-400e-8a1a-409d88cb5fd5', '318e70d1-e99f-4ef2-b82d-b2d9829e34da', 'c47e380d-3f56-4be3-bbe8-f0bc1973b8e5', 'ac851472-e8ef-4b72-a14b-ed4b93e3f814'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:08:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a435d1b8-603c-4e33-af81-18b5987471ad tempest-AttachVolumeShelveTestJSON-1918775869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:08:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a435d1b8-603c-4e33-af81-18b5987471ad tempest-AttachVolumeShelveTestJSON-1918775869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:08:01 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-a435d1b8-603c-4e33-af81-18b5987471ad tempest-AttachVolumeShelveTestJSON-1918775869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:08:01 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-a435d1b8-603c-4e33-af81-18b5987471ad tempest-AttachVolumeShelveTestJSON-1918775869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:08:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a435d1b8-603c-4e33-af81-18b5987471ad tempest-AttachVolumeShelveTestJSON-1918775869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:08:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a435d1b8-603c-4e33-af81-18b5987471ad tempest-AttachVolumeShelveTestJSON-1918775869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:08:01 devstack sudo[89833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:08:01 devstack sudo[89833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:08:01 devstack sudo[89833]: pam_unix(sudo:session): session closed for user root Jul 21 02:08:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a435d1b8-603c-4e33-af81-18b5987471ad tempest-AttachVolumeShelveTestJSON-1918775869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.273s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:08:01 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-a435d1b8-603c-4e33-af81-18b5987471ad tempest-AttachVolumeShelveTestJSON-1918775869 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:08:01 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-a435d1b8-603c-4e33-af81-18b5987471ad tempest-AttachVolumeShelveTestJSON-1918775869 None] Deleted volume successfully. Jul 21 02:08:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a435d1b8-603c-4e33-af81-18b5987471ad tempest-AttachVolumeShelveTestJSON-1918775869 None] Lock "cinder-18335f31-785d-40d8-a1c2-e08235833720-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:08:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-67bddd73-c8c0-4561-838c-10f8498e8d8a req-4fcd495c-ac92-40f3-afc3-6e4791d1ba49 tempest-ServerActionsTestOtherA-1081708656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:08:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-67bddd73-c8c0-4561-838c-10f8498e8d8a req-4fcd495c-ac92-40f3-afc3-6e4791d1ba49 tempest-ServerActionsTestOtherA-1081708656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:08:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-67bddd73-c8c0-4561-838c-10f8498e8d8a req-4fcd495c-ac92-40f3-afc3-6e4791d1ba49 tempest-ServerActionsTestOtherA-1081708656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:08:02 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-67bddd73-c8c0-4561-838c-10f8498e8d8a req-4fcd495c-ac92-40f3-afc3-6e4791d1ba49 tempest-ServerActionsTestOtherA-1081708656 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea', 'name': 'volume-28b68324-4639-47fd-be60-96a529fa00a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '423e6edb-5aad-4632-a33a-2874fa9d6f1d', 'enforce_multipath': True} {{(pid=87566) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 02:08:02 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-67bddd73-c8c0-4561-838c-10f8498e8d8a req-4fcd495c-ac92-40f3-afc3-6e4791d1ba49 tempest-ServerActionsTestOtherA-1081708656 None] attachment_update completed successfully. Jul 21 02:08:07 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-cf2de3dc-2868-412e-9a83-c770cf0943aa req-f3689939-4ad7-4701-9484-07309721bfb3 tempest-ServerActionsTestOtherA-1081708656 None] Terminate volume connection completed successfully. Jul 21 02:08:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-cf2de3dc-2868-412e-9a83-c770cf0943aa req-f3689939-4ad7-4701-9484-07309721bfb3 tempest-ServerActionsTestOtherA-1081708656 None] Deleting attachment 423e6edb-5aad-4632-a33a-2874fa9d6f1d. {{(pid=87566) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 02:08:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-3fc4d074-7bee-47f5-86e4-5f4a1a6ecea7 req-81447207-cdf1-403f-aced-be01f4fa0532 tempest-TaggedAttachmentsTest-673283936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:08:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-3fc4d074-7bee-47f5-86e4-5f4a1a6ecea7 req-81447207-cdf1-403f-aced-be01f4fa0532 tempest-TaggedAttachmentsTest-673283936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:08:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-3fc4d074-7bee-47f5-86e4-5f4a1a6ecea7 req-81447207-cdf1-403f-aced-be01f4fa0532 tempest-TaggedAttachmentsTest-673283936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:08:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-3fc4d074-7bee-47f5-86e4-5f4a1a6ecea7 req-81447207-cdf1-403f-aced-be01f4fa0532 tempest-TaggedAttachmentsTest-673283936 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea', 'name': 'volume-13e483c3-5db9-4aef-b543-fbe9c6072fe4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'db83da47-9297-4cce-bd1b-9842d5d59395', 'enforce_multipath': True} {{(pid=87566) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 02:08:09 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-3fc4d074-7bee-47f5-86e4-5f4a1a6ecea7 req-81447207-cdf1-403f-aced-be01f4fa0532 tempest-TaggedAttachmentsTest-673283936 None] attachment_update completed successfully. Jul 21 02:08:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-cf2de3dc-2868-412e-9a83-c770cf0943aa req-1bc13b5f-7686-4518-906f-10728e1b7dea tempest-ServerActionsTestOtherA-1081708656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:08:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-cf2de3dc-2868-412e-9a83-c770cf0943aa req-1bc13b5f-7686-4518-906f-10728e1b7dea tempest-ServerActionsTestOtherA-1081708656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:08:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-cf2de3dc-2868-412e-9a83-c770cf0943aa req-1bc13b5f-7686-4518-906f-10728e1b7dea tempest-ServerActionsTestOtherA-1081708656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:08:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-cf2de3dc-2868-412e-9a83-c770cf0943aa req-1bc13b5f-7686-4518-906f-10728e1b7dea tempest-ServerActionsTestOtherA-1081708656 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea', 'name': 'volume-28b68324-4639-47fd-be60-96a529fa00a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a366c023-aae1-4438-8ec5-9f313fad3503', 'enforce_multipath': True} {{(pid=87566) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 02:08:09 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-cf2de3dc-2868-412e-9a83-c770cf0943aa req-1bc13b5f-7686-4518-906f-10728e1b7dea tempest-ServerActionsTestOtherA-1081708656 None] attachment_update completed successfully. Jul 21 02:08:15 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-bdcc40b7-8753-4358-a174-aaf66ca91af8 req-511142c4-ee36-4d03-ab7b-d9af93157e10 tempest-TaggedAttachmentsTest-673283936 None] Terminate volume connection completed successfully. Jul 21 02:08:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-bdcc40b7-8753-4358-a174-aaf66ca91af8 req-511142c4-ee36-4d03-ab7b-d9af93157e10 tempest-TaggedAttachmentsTest-673283936 None] Deleting attachment db83da47-9297-4cce-bd1b-9842d5d59395. {{(pid=87566) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 02:08:17 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:08:17 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] Flow 'volume_create_manager' (3b29e7c5-c7b3-4bc5-91a9-ab73d3b28854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:08:17 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f1ab99-c33b-4411-8f3a-a6e90ac2921d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:08:17 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f1ab99-c33b-4411-8f3a-a6e90ac2921d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1045847761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a47a27e-3ef8-4cc5-9069-234cf5d21791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5752a8f378a44af5ba968402a546c856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:08:17Z,use_quota=True,user_id='d95fc9d985484df6aeabb9d0bdac76ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:08:17 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac50ec99-46a9-42b4-bef5-2e9913ca8685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:08:17 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac50ec99-46a9-42b4-bef5-2e9913ca8685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:08:17 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a93d1e-6f71-49b0-83c5-7e75416860f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:08:17 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a93d1e-6f71-49b0-83c5-7e75416860f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a47a27e-3ef8-4cc5-9069-234cf5d21791', 'volume_name': 'volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:08:17 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2d3612-707c-4524-b2e7-00fd5f8c8d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:08:17 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2d3612-707c-4524-b2e7-00fd5f8c8d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:08:17 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc7b274-144b-4378-81af-fb4cebbfa14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:08:17 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] Volume 3a47a27e-3ef8-4cc5-9069-234cf5d21791: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791', 'volume_size': 1} Jul 21 02:08:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:08:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:08:17 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1045847761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a47a27e-3ef8-4cc5-9069-234cf5d21791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5752a8f378a44af5ba968402a546c856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:08:17Z,use_quota=True,user_id='d95fc9d985484df6aeabb9d0bdac76ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:08:17 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] Creating volume 3a47a27e-3ef8-4cc5-9069-234cf5d21791 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:08:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:08:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:08:17 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:08:17 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:08:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:08:17 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:08:17 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:08:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:08:17 devstack sudo[90909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791 1073741824 Jul 21 02:08:17 devstack sudo[90909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:08:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791 1073741824" returned: 0 in 0.765s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:08:18 devstack sudo[90909]: pam_unix(sudo:session): session closed for user root Jul 21 02:08:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:08:18 devstack sudo[90917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791 Jul 21 02:08:18 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:08:19 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root Jul 21 02:08:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791" returned: 0 in 0.724s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:08:19 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:08:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:08:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc7b274-144b-4378-81af-fb4cebbfa14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:08:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e4a7706-8f24-45b6-aea7-fea7a173695d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:08:19 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] Volume volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791 (3a47a27e-3ef8-4cc5-9069-234cf5d21791): created successfully Jul 21 02:08:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e4a7706-8f24-45b6-aea7-fea7a173695d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:08:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] Flow 'volume_create_manager' (3b29e7c5-c7b3-4bc5-91a9-ab73d3b28854) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:08:19 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-d753d382-cae9-4ed5-88c5-04406d44812d req-243f48b8-a9a3-4d79-a941-cd44dc1594b4 tempest-VolumesSnapshotsTestJSON-1549047348 None] Created volume successfully. Jul 21 02:08:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-860dc4c4-3682-4c08-b7d4-fabd93b4778a req-45659fdb-37b3-4451-842a-32b758dd5ba1 tempest-VolumesSnapshotsTestJSON-1549047348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:08:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-860dc4c4-3682-4c08-b7d4-fabd93b4778a req-45659fdb-37b3-4451-842a-32b758dd5ba1 tempest-VolumesSnapshotsTestJSON-1549047348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:08:21 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [req-860dc4c4-3682-4c08-b7d4-fabd93b4778a req-45659fdb-37b3-4451-842a-32b758dd5ba1 tempest-VolumesSnapshotsTestJSON-1549047348 None] Creating offline snapshot 4944512b-64d9-4a9b-9c37-1fecea5499b9 of volume 3a47a27e-3ef8-4cc5-9069-234cf5d21791 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:08:21 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[c732db96-6c48-461e-84b0-ca113ed2ac84]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:08:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-860dc4c4-3682-4c08-b7d4-fabd93b4778a req-45659fdb-37b3-4451-842a-32b758dd5ba1 tempest-VolumesSnapshotsTestJSON-1549047348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:08:21 devstack sudo[91004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791 Jul 21 02:08:21 devstack sudo[91004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:08:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-860dc4c4-3682-4c08-b7d4-fabd93b4778a req-45659fdb-37b3-4451-842a-32b758dd5ba1 tempest-VolumesSnapshotsTestJSON-1549047348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791" returned: 0 in 1.395s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:08:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-860dc4c4-3682-4c08-b7d4-fabd93b4778a req-45659fdb-37b3-4451-842a-32b758dd5ba1 tempest-VolumesSnapshotsTestJSON-1549047348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791.4944512b-64d9-4a9b-9c37-1fecea5499b9 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:08:22 devstack sudo[91004]: pam_unix(sudo:session): session closed for user root Jul 21 02:08:23 devstack sudo[91035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791.4944512b-64d9-4a9b-9c37-1fecea5499b9 1G Jul 21 02:08:23 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:08:24 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root Jul 21 02:08:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-860dc4c4-3682-4c08-b7d4-fabd93b4778a req-45659fdb-37b3-4451-842a-32b758dd5ba1 tempest-VolumesSnapshotsTestJSON-1549047348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791.4944512b-64d9-4a9b-9c37-1fecea5499b9 1G" returned: 0 in 1.415s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:08:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-860dc4c4-3682-4c08-b7d4-fabd93b4778a req-45659fdb-37b3-4451-842a-32b758dd5ba1 tempest-VolumesSnapshotsTestJSON-1549047348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791.4944512b-64d9-4a9b-9c37-1fecea5499b9 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:08:24 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791.4944512b-64d9-4a9b-9c37-1fecea5499b9 Jul 21 02:08:24 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:08:24 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Jul 21 02:08:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-860dc4c4-3682-4c08-b7d4-fabd93b4778a req-45659fdb-37b3-4451-842a-32b758dd5ba1 tempest-VolumesSnapshotsTestJSON-1549047348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791.4944512b-64d9-4a9b-9c37-1fecea5499b9" returned: 0 in 0.563s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:08:24 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [req-860dc4c4-3682-4c08-b7d4-fabd93b4778a req-45659fdb-37b3-4451-842a-32b758dd5ba1 tempest-VolumesSnapshotsTestJSON-1549047348 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791.4944512b-64d9-4a9b-9c37-1fecea5499b9 is being set with open permissions: ugo+rw Jul 21 02:08:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-860dc4c4-3682-4c08-b7d4-fabd93b4778a req-45659fdb-37b3-4451-842a-32b758dd5ba1 tempest-VolumesSnapshotsTestJSON-1549047348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791.4944512b-64d9-4a9b-9c37-1fecea5499b9 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:08:24 devstack sudo[91053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791.4944512b-64d9-4a9b-9c37-1fecea5499b9 Jul 21 02:08:24 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:08:25 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root Jul 21 02:08:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-860dc4c4-3682-4c08-b7d4-fabd93b4778a req-45659fdb-37b3-4451-842a-32b758dd5ba1 tempest-VolumesSnapshotsTestJSON-1549047348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791.4944512b-64d9-4a9b-9c37-1fecea5499b9" returned: 0 in 0.561s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:08:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-860dc4c4-3682-4c08-b7d4-fabd93b4778a req-45659fdb-37b3-4451-842a-32b758dd5ba1 tempest-VolumesSnapshotsTestJSON-1549047348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:08:25 devstack sudo[91058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791.info Jul 21 02:08:25 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:08:26 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root Jul 21 02:08:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-860dc4c4-3682-4c08-b7d4-fabd93b4778a req-45659fdb-37b3-4451-842a-32b758dd5ba1 tempest-VolumesSnapshotsTestJSON-1549047348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791.info" returned: 0 in 0.831s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:08:26 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [req-860dc4c4-3682-4c08-b7d4-fabd93b4778a req-45659fdb-37b3-4451-842a-32b758dd5ba1 tempest-VolumesSnapshotsTestJSON-1549047348 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791.info is being set with open permissions: ugo+rw Jul 21 02:08:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-860dc4c4-3682-4c08-b7d4-fabd93b4778a req-45659fdb-37b3-4451-842a-32b758dd5ba1 tempest-VolumesSnapshotsTestJSON-1549047348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:08:26 devstack sudo[91061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791.info Jul 21 02:08:26 devstack sudo[91061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:08:27 devstack sudo[91061]: pam_unix(sudo:session): session closed for user root Jul 21 02:08:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-860dc4c4-3682-4c08-b7d4-fabd93b4778a req-45659fdb-37b3-4451-842a-32b758dd5ba1 tempest-VolumesSnapshotsTestJSON-1549047348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791.info" returned: 0 in 0.689s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:08:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-860dc4c4-3682-4c08-b7d4-fabd93b4778a req-45659fdb-37b3-4451-842a-32b758dd5ba1 tempest-VolumesSnapshotsTestJSON-1549047348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.770s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:08:27 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-860dc4c4-3682-4c08-b7d4-fabd93b4778a req-45659fdb-37b3-4451-842a-32b758dd5ba1 tempest-VolumesSnapshotsTestJSON-1549047348 None] Create snapshot completed successfully Jul 21 02:08:28 devstack cinder-volume[87566]: DEBUG cinder.coordination [req-d1209479-2990-48ab-8052-86f7768a6061 req-2f3719f8-2784-4c3e-8e72-f6177e6503f2 tempest-VolumesSnapshotsTestJSON-1549047348 None] Acquiring lock "cinder-4944512b-64d9-4a9b-9c37-1fecea5499b9-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:08:28 devstack cinder-volume[87566]: DEBUG cinder.coordination [req-d1209479-2990-48ab-8052-86f7768a6061 req-2f3719f8-2784-4c3e-8e72-f6177e6503f2 tempest-VolumesSnapshotsTestJSON-1549047348 None] Lock "cinder-4944512b-64d9-4a9b-9c37-1fecea5499b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:08:28 devstack cinder-volume[87566]: DEBUG cinder.coordination [req-d1209479-2990-48ab-8052-86f7768a6061 req-2f3719f8-2784-4c3e-8e72-f6177e6503f2 tempest-VolumesSnapshotsTestJSON-1549047348 None] Acquiring lock "cinder-quobyte-3a47a27e-3ef8-4cc5-9069-234cf5d21791" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:08:28 devstack cinder-volume[87566]: DEBUG cinder.coordination [req-d1209479-2990-48ab-8052-86f7768a6061 req-2f3719f8-2784-4c3e-8e72-f6177e6503f2 tempest-VolumesSnapshotsTestJSON-1549047348 None] Lock "cinder-quobyte-3a47a27e-3ef8-4cc5-9069-234cf5d21791" acquired by "delete_snapshot" :: waited 0.087s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:08:28 devstack cinder-volume[87566]: DEBUG cinder.coordination [req-d1209479-2990-48ab-8052-86f7768a6061 req-2f3719f8-2784-4c3e-8e72-f6177e6503f2 tempest-VolumesSnapshotsTestJSON-1549047348 None] Acquiring lock "cinder-quobyte-4944512b-64d9-4a9b-9c37-1fecea5499b9" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:08:28 devstack cinder-volume[87566]: DEBUG cinder.coordination [req-d1209479-2990-48ab-8052-86f7768a6061 req-2f3719f8-2784-4c3e-8e72-f6177e6503f2 tempest-VolumesSnapshotsTestJSON-1549047348 None] Lock "cinder-quobyte-4944512b-64d9-4a9b-9c37-1fecea5499b9" acquired by "_delete_snapshot" :: waited 0.062s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:08:28 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [req-d1209479-2990-48ab-8052-86f7768a6061 req-2f3719f8-2784-4c3e-8e72-f6177e6503f2 tempest-VolumesSnapshotsTestJSON-1549047348 None] Deleting offline snapshot 4944512b-64d9-4a9b-9c37-1fecea5499b9 of volume 3a47a27e-3ef8-4cc5-9069-234cf5d21791 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:08:28 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [req-d1209479-2990-48ab-8052-86f7768a6061 req-2f3719f8-2784-4c3e-8e72-f6177e6503f2 tempest-VolumesSnapshotsTestJSON-1549047348 None] snapshot_file for this snap is: volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791.4944512b-64d9-4a9b-9c37-1fecea5499b9 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:08:28 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fae46b-c473-4a08-9f07-9716e4660452]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:08:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-d1209479-2990-48ab-8052-86f7768a6061 req-2f3719f8-2784-4c3e-8e72-f6177e6503f2 tempest-VolumesSnapshotsTestJSON-1549047348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791.4944512b-64d9-4a9b-9c37-1fecea5499b9 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:08:29 devstack sudo[91101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791.4944512b-64d9-4a9b-9c37-1fecea5499b9 Jul 21 02:08:29 devstack sudo[91101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:08:29 devstack sudo[91101]: pam_unix(sudo:session): session closed for user root Jul 21 02:08:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-d1209479-2990-48ab-8052-86f7768a6061 req-2f3719f8-2784-4c3e-8e72-f6177e6503f2 tempest-VolumesSnapshotsTestJSON-1549047348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791.4944512b-64d9-4a9b-9c37-1fecea5499b9" returned: 0 in 1.154s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:08:29 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [req-d1209479-2990-48ab-8052-86f7768a6061 req-2f3719f8-2784-4c3e-8e72-f6177e6503f2 tempest-VolumesSnapshotsTestJSON-1549047348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:08:30 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdef6e0-3986-4343-97d5-62d209c9a8d3]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:08:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-d1209479-2990-48ab-8052-86f7768a6061 req-2f3719f8-2784-4c3e-8e72-f6177e6503f2 tempest-VolumesSnapshotsTestJSON-1549047348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:08:30 devstack sudo[91180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791 Jul 21 02:08:30 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:08:30 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root Jul 21 02:08:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-d1209479-2990-48ab-8052-86f7768a6061 req-2f3719f8-2784-4c3e-8e72-f6177e6503f2 tempest-VolumesSnapshotsTestJSON-1549047348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791" returned: 0 in 0.824s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:08:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-d1209479-2990-48ab-8052-86f7768a6061 req-2f3719f8-2784-4c3e-8e72-f6177e6503f2 tempest-VolumesSnapshotsTestJSON-1549047348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791.4944512b-64d9-4a9b-9c37-1fecea5499b9 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:08:30 devstack sudo[91195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791.4944512b-64d9-4a9b-9c37-1fecea5499b9 Jul 21 02:08:30 devstack sudo[91195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:08:31 devstack sudo[91195]: pam_unix(sudo:session): session closed for user root Jul 21 02:08:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-d1209479-2990-48ab-8052-86f7768a6061 req-2f3719f8-2784-4c3e-8e72-f6177e6503f2 tempest-VolumesSnapshotsTestJSON-1549047348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791.4944512b-64d9-4a9b-9c37-1fecea5499b9" returned: 0 in 0.751s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:08:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-d1209479-2990-48ab-8052-86f7768a6061 req-2f3719f8-2784-4c3e-8e72-f6177e6503f2 tempest-VolumesSnapshotsTestJSON-1549047348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791.4944512b-64d9-4a9b-9c37-1fecea5499b9 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:08:31 devstack sudo[91200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791.4944512b-64d9-4a9b-9c37-1fecea5499b9 Jul 21 02:08:31 devstack sudo[91200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:08:32 devstack sudo[91200]: pam_unix(sudo:session): session closed for user root Jul 21 02:08:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-d1209479-2990-48ab-8052-86f7768a6061 req-2f3719f8-2784-4c3e-8e72-f6177e6503f2 tempest-VolumesSnapshotsTestJSON-1549047348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791.4944512b-64d9-4a9b-9c37-1fecea5499b9" returned: 0 in 0.691s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:08:32 devstack cinder-volume[87566]: DEBUG cinder.coordination [req-d1209479-2990-48ab-8052-86f7768a6061 req-2f3719f8-2784-4c3e-8e72-f6177e6503f2 tempest-VolumesSnapshotsTestJSON-1549047348 None] Lock "cinder-quobyte-4944512b-64d9-4a9b-9c37-1fecea5499b9" released by "_delete_snapshot" :: held 3.702s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:08:32 devstack cinder-volume[87566]: DEBUG cinder.coordination [req-d1209479-2990-48ab-8052-86f7768a6061 req-2f3719f8-2784-4c3e-8e72-f6177e6503f2 tempest-VolumesSnapshotsTestJSON-1549047348 None] Lock "cinder-quobyte-3a47a27e-3ef8-4cc5-9069-234cf5d21791" released by "delete_snapshot" :: held 3.780s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:08:32 devstack cinder-volume[87566]: WARNING cinder.quota [req-d1209479-2990-48ab-8052-86f7768a6061 req-2f3719f8-2784-4c3e-8e72-f6177e6503f2 tempest-VolumesSnapshotsTestJSON-1549047348 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 21 02:08:32 devstack cinder-volume[87566]: DEBUG cinder.quota [req-d1209479-2990-48ab-8052-86f7768a6061 req-2f3719f8-2784-4c3e-8e72-f6177e6503f2 tempest-VolumesSnapshotsTestJSON-1549047348 None] Created reservations ['64f1de25-da73-4244-8460-b3b95d561edc', '9dbb9cda-222f-4c4b-a67d-01ac0a8fad0f', '85c40871-54c6-415b-99b1-e00c93b0cf73', 'c94c68f2-77bc-4627-ab3f-1b9e71edf163'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:08:32 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-d1209479-2990-48ab-8052-86f7768a6061 req-2f3719f8-2784-4c3e-8e72-f6177e6503f2 tempest-VolumesSnapshotsTestJSON-1549047348 None] Delete snapshot completed successfully. Jul 21 02:08:32 devstack cinder-volume[87566]: DEBUG cinder.coordination [req-d1209479-2990-48ab-8052-86f7768a6061 req-2f3719f8-2784-4c3e-8e72-f6177e6503f2 tempest-VolumesSnapshotsTestJSON-1549047348 None] Lock "cinder-4944512b-64d9-4a9b-9c37-1fecea5499b9-delete_snapshot" released by "delete_snapshot" :: held 4.056s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:08:33 devstack cinder-volume[87566]: DEBUG cinder.coordination [req-d30f3aec-6242-47c5-881e-963ae5c8549c req-b9c39160-961d-4ca8-9dc3-d9de829b7b80 tempest-VolumesSnapshotsTestJSON-1549047348 None] Acquiring lock "cinder-3a47a27e-3ef8-4cc5-9069-234cf5d21791-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:08:33 devstack cinder-volume[87566]: DEBUG cinder.coordination [req-d30f3aec-6242-47c5-881e-963ae5c8549c req-b9c39160-961d-4ca8-9dc3-d9de829b7b80 tempest-VolumesSnapshotsTestJSON-1549047348 None] Lock "cinder-3a47a27e-3ef8-4cc5-9069-234cf5d21791-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:08:33 devstack cinder-volume[87566]: DEBUG cinder.coordination [req-d30f3aec-6242-47c5-881e-963ae5c8549c req-b9c39160-961d-4ca8-9dc3-d9de829b7b80 tempest-VolumesSnapshotsTestJSON-1549047348 None] Acquiring lock "cinder-quobyte-3a47a27e-3ef8-4cc5-9069-234cf5d21791" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:08:33 devstack cinder-volume[87566]: DEBUG cinder.coordination [req-d30f3aec-6242-47c5-881e-963ae5c8549c req-b9c39160-961d-4ca8-9dc3-d9de829b7b80 tempest-VolumesSnapshotsTestJSON-1549047348 None] Lock "cinder-quobyte-3a47a27e-3ef8-4cc5-9069-234cf5d21791" acquired by "delete_volume" :: waited 0.042s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:08:33 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[45297d41-9671-4e2a-8711-f827d06d433e]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:08:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-d30f3aec-6242-47c5-881e-963ae5c8549c req-b9c39160-961d-4ca8-9dc3-d9de829b7b80 tempest-VolumesSnapshotsTestJSON-1549047348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:08:34 devstack sudo[91206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791 Jul 21 02:08:34 devstack sudo[91206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:08:34 devstack sudo[91206]: pam_unix(sudo:session): session closed for user root Jul 21 02:08:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-d30f3aec-6242-47c5-881e-963ae5c8549c req-b9c39160-961d-4ca8-9dc3-d9de829b7b80 tempest-VolumesSnapshotsTestJSON-1549047348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791" returned: 0 in 0.835s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:08:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-d30f3aec-6242-47c5-881e-963ae5c8549c req-b9c39160-961d-4ca8-9dc3-d9de829b7b80 tempest-VolumesSnapshotsTestJSON-1549047348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:08:34 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:08:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] Flow 'volume_create_manager' (04b92fa1-12c0-49d8-8a88-675988268508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:08:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b345973d-5860-4ea7-b510-4d1a7433d9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:08:34 devstack sudo[91213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791 Jul 21 02:08:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b345973d-5860-4ea7-b510-4d1a7433d9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1608675738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=896b3140-3699-445c-a0a3-efb26660a851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352bce6ca15542469d00bbc2ed313b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:08:34Z,use_quota=True,user_id='070452a6fa614aa5b31068b42c377d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:08:34 devstack sudo[91213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:08:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (853f8b8d-df48-473c-bfe2-efe76f869a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:08:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (853f8b8d-df48-473c-bfe2-efe76f869a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:08:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace7a0f3-b0f2-439d-89f1-d65efb905283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:08:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace7a0f3-b0f2-439d-89f1-d65efb905283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '896b3140-3699-445c-a0a3-efb26660a851', 'volume_name': 'volume-896b3140-3699-445c-a0a3-efb26660a851', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:08:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bdb484f-80b2-41e2-851c-547bdd782517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:08:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bdb484f-80b2-41e2-851c-547bdd782517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:08:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba2da8e-f0c5-4b5e-8af5-3977904eebc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:08:34 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] Volume 896b3140-3699-445c-a0a3-efb26660a851: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-896b3140-3699-445c-a0a3-efb26660a851', 'volume_size': 1} Jul 21 02:08:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:08:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:08:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1608675738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=896b3140-3699-445c-a0a3-efb26660a851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352bce6ca15542469d00bbc2ed313b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:08:34Z,use_quota=True,user_id='070452a6fa614aa5b31068b42c377d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:08:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] Creating volume 896b3140-3699-445c-a0a3-efb26660a851 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:08:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:08:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:08:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:08:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:08:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:08:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:08:34 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:08:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-896b3140-3699-445c-a0a3-efb26660a851 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:08:34 devstack sudo[91215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-896b3140-3699-445c-a0a3-efb26660a851 1073741824 Jul 21 02:08:34 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:08:35 devstack sudo[91213]: pam_unix(sudo:session): session closed for user root Jul 21 02:08:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-d30f3aec-6242-47c5-881e-963ae5c8549c req-b9c39160-961d-4ca8-9dc3-d9de829b7b80 tempest-VolumesSnapshotsTestJSON-1549047348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a47a27e-3ef8-4cc5-9069-234cf5d21791" returned: 0 in 0.636s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:08:35 devstack cinder-volume[87566]: DEBUG cinder.coordination [req-d30f3aec-6242-47c5-881e-963ae5c8549c req-b9c39160-961d-4ca8-9dc3-d9de829b7b80 tempest-VolumesSnapshotsTestJSON-1549047348 None] Lock "cinder-quobyte-3a47a27e-3ef8-4cc5-9069-234cf5d21791" released by "delete_volume" :: held 1.580s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:08:35 devstack cinder-volume[87566]: DEBUG cinder.quota [req-d30f3aec-6242-47c5-881e-963ae5c8549c req-b9c39160-961d-4ca8-9dc3-d9de829b7b80 tempest-VolumesSnapshotsTestJSON-1549047348 None] Created reservations ['2be17aed-6090-4c63-aef8-f2b4a8de2393', 'b2a513e9-dc33-48f3-a353-f3b08511154c', 'a953cdb1-b880-4465-a027-833425975804', '62985f91-9a65-49c2-9789-c3593320f21d'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:08:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-d30f3aec-6242-47c5-881e-963ae5c8549c req-b9c39160-961d-4ca8-9dc3-d9de829b7b80 tempest-VolumesSnapshotsTestJSON-1549047348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:08:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-d30f3aec-6242-47c5-881e-963ae5c8549c req-b9c39160-961d-4ca8-9dc3-d9de829b7b80 tempest-VolumesSnapshotsTestJSON-1549047348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:08:35 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [req-d30f3aec-6242-47c5-881e-963ae5c8549c req-b9c39160-961d-4ca8-9dc3-d9de829b7b80 tempest-VolumesSnapshotsTestJSON-1549047348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:08:35 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [req-d30f3aec-6242-47c5-881e-963ae5c8549c req-b9c39160-961d-4ca8-9dc3-d9de829b7b80 tempest-VolumesSnapshotsTestJSON-1549047348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:08:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-d30f3aec-6242-47c5-881e-963ae5c8549c req-b9c39160-961d-4ca8-9dc3-d9de829b7b80 tempest-VolumesSnapshotsTestJSON-1549047348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:08:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-d30f3aec-6242-47c5-881e-963ae5c8549c req-b9c39160-961d-4ca8-9dc3-d9de829b7b80 tempest-VolumesSnapshotsTestJSON-1549047348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:08:35 devstack sudo[91222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:08:35 devstack sudo[91222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:08:35 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root Jul 21 02:08:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-896b3140-3699-445c-a0a3-efb26660a851 1073741824" returned: 0 in 0.790s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:08:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-896b3140-3699-445c-a0a3-efb26660a851 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:08:35 devstack sudo[91224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-896b3140-3699-445c-a0a3-efb26660a851 Jul 21 02:08:35 devstack sudo[91224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:08:35 devstack sudo[91222]: pam_unix(sudo:session): session closed for user root Jul 21 02:08:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-d30f3aec-6242-47c5-881e-963ae5c8549c req-b9c39160-961d-4ca8-9dc3-d9de829b7b80 tempest-VolumesSnapshotsTestJSON-1549047348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.420s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:08:35 devstack cinder-volume[87566]: DEBUG cinder.manager [req-d30f3aec-6242-47c5-881e-963ae5c8549c req-b9c39160-961d-4ca8-9dc3-d9de829b7b80 tempest-VolumesSnapshotsTestJSON-1549047348 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:08:35 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-d30f3aec-6242-47c5-881e-963ae5c8549c req-b9c39160-961d-4ca8-9dc3-d9de829b7b80 tempest-VolumesSnapshotsTestJSON-1549047348 None] Deleted volume successfully. Jul 21 02:08:36 devstack cinder-volume[87566]: DEBUG cinder.coordination [req-d30f3aec-6242-47c5-881e-963ae5c8549c req-b9c39160-961d-4ca8-9dc3-d9de829b7b80 tempest-VolumesSnapshotsTestJSON-1549047348 None] Lock "cinder-3a47a27e-3ef8-4cc5-9069-234cf5d21791-delete_volume" released by "delete_volume" :: held 2.477s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:08:36 devstack sudo[91224]: pam_unix(sudo:session): session closed for user root Jul 21 02:08:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-896b3140-3699-445c-a0a3-efb26660a851" returned: 0 in 0.630s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:08:36 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:08:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:08:36 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba2da8e-f0c5-4b5e-8af5-3977904eebc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-896b3140-3699-445c-a0a3-efb26660a851', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:08:36 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1343f9e-3ebd-466a-b85f-4507a0c76ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:08:36 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] Volume volume-896b3140-3699-445c-a0a3-efb26660a851 (896b3140-3699-445c-a0a3-efb26660a851): created successfully Jul 21 02:08:36 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1343f9e-3ebd-466a-b85f-4507a0c76ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:08:36 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] Flow 'volume_create_manager' (04b92fa1-12c0-49d8-8a88-675988268508) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:08:36 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-60a18b06-ef15-4e1b-acc7-fc1cc9dac881 tempest-ServerRescueNegativeTestJSON-1821631500 None] Created volume successfully. Jul 21 02:08:37 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d61ec033-7df9-465b-9cf4-a51624453a5d tempest-TaggedAttachmentsTest-673283936 None] Acquiring lock "cinder-13e483c3-5db9-4aef-b543-fbe9c6072fe4-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:08:37 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d61ec033-7df9-465b-9cf4-a51624453a5d tempest-TaggedAttachmentsTest-673283936 None] Lock "cinder-13e483c3-5db9-4aef-b543-fbe9c6072fe4-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:08:37 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d61ec033-7df9-465b-9cf4-a51624453a5d tempest-TaggedAttachmentsTest-673283936 None] Acquiring lock "cinder-quobyte-13e483c3-5db9-4aef-b543-fbe9c6072fe4" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:08:37 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d61ec033-7df9-465b-9cf4-a51624453a5d tempest-TaggedAttachmentsTest-673283936 None] Lock "cinder-quobyte-13e483c3-5db9-4aef-b543-fbe9c6072fe4" acquired by "delete_volume" :: waited 0.044s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:08:37 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[164a6951-6d7a-4fd2-84e3-11a0f03f370e]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:08:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d61ec033-7df9-465b-9cf4-a51624453a5d tempest-TaggedAttachmentsTest-673283936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13e483c3-5db9-4aef-b543-fbe9c6072fe4 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:08:37 devstack sudo[91230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13e483c3-5db9-4aef-b543-fbe9c6072fe4 Jul 21 02:08:37 devstack sudo[91230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:08:38 devstack sudo[91230]: pam_unix(sudo:session): session closed for user root Jul 21 02:08:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d61ec033-7df9-465b-9cf4-a51624453a5d tempest-TaggedAttachmentsTest-673283936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13e483c3-5db9-4aef-b543-fbe9c6072fe4" returned: 0 in 0.737s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:08:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d61ec033-7df9-465b-9cf4-a51624453a5d tempest-TaggedAttachmentsTest-673283936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13e483c3-5db9-4aef-b543-fbe9c6072fe4 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:08:38 devstack sudo[91247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13e483c3-5db9-4aef-b543-fbe9c6072fe4 Jul 21 02:08:38 devstack sudo[91247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:08:38 devstack sudo[91247]: pam_unix(sudo:session): session closed for user root Jul 21 02:08:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d61ec033-7df9-465b-9cf4-a51624453a5d tempest-TaggedAttachmentsTest-673283936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13e483c3-5db9-4aef-b543-fbe9c6072fe4" returned: 0 in 0.754s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:08:39 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d61ec033-7df9-465b-9cf4-a51624453a5d tempest-TaggedAttachmentsTest-673283936 None] Lock "cinder-quobyte-13e483c3-5db9-4aef-b543-fbe9c6072fe4" released by "delete_volume" :: held 1.579s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:08:39 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-d61ec033-7df9-465b-9cf4-a51624453a5d tempest-TaggedAttachmentsTest-673283936 None] Created reservations ['fa5ca634-a1ac-47e0-b20f-44083778a503', '7b5a0ca2-c515-490c-87ba-1ab185111707', '9307be5e-67d4-4e26-93b8-991a09342ab7', '70df91db-dbef-49c6-aeeb-2564644d8113'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:08:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d61ec033-7df9-465b-9cf4-a51624453a5d tempest-TaggedAttachmentsTest-673283936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:08:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d61ec033-7df9-465b-9cf4-a51624453a5d tempest-TaggedAttachmentsTest-673283936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:08:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d61ec033-7df9-465b-9cf4-a51624453a5d tempest-TaggedAttachmentsTest-673283936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:08:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d61ec033-7df9-465b-9cf4-a51624453a5d tempest-TaggedAttachmentsTest-673283936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:08:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d61ec033-7df9-465b-9cf4-a51624453a5d tempest-TaggedAttachmentsTest-673283936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:08:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d61ec033-7df9-465b-9cf4-a51624453a5d tempest-TaggedAttachmentsTest-673283936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:08:39 devstack sudo[91267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:08:39 devstack sudo[91267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:08:39 devstack sudo[91267]: pam_unix(sudo:session): session closed for user root Jul 21 02:08:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d61ec033-7df9-465b-9cf4-a51624453a5d tempest-TaggedAttachmentsTest-673283936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.556s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:08:39 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-d61ec033-7df9-465b-9cf4-a51624453a5d tempest-TaggedAttachmentsTest-673283936 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:08:39 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-d61ec033-7df9-465b-9cf4-a51624453a5d tempest-TaggedAttachmentsTest-673283936 None] Deleted volume successfully. Jul 21 02:08:39 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d61ec033-7df9-465b-9cf4-a51624453a5d tempest-TaggedAttachmentsTest-673283936 None] Lock "cinder-13e483c3-5db9-4aef-b543-fbe9c6072fe4-delete_volume" released by "delete_volume" :: held 2.604s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:08:44 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-0f6aae04-8b2c-412e-9ba8-1a4f79acdcfc req-78489712-57e6-4a60-8bd5-736d78728955 tempest-ServerActionsTestOtherA-1081708656 None] Terminate volume connection completed successfully. Jul 21 02:08:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-0f6aae04-8b2c-412e-9ba8-1a4f79acdcfc req-78489712-57e6-4a60-8bd5-736d78728955 tempest-ServerActionsTestOtherA-1081708656 None] Deleting attachment a366c023-aae1-4438-8ec5-9f313fad3503. {{(pid=87566) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 02:08:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2f08745b-e1d4-4209-a3aa-077f7ff8911c tempest-BackendsCapabilitiesAdminTestsJSON-1081595869 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87566) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 21 02:08:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e29e1de3-9a15-488c-8411-9541ebf0a251 tempest-BackendsCapabilitiesAdminTestsJSON-1081595869 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87566) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 21 02:08:48 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:08:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:08:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:08:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:08:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:08:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:08:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:08:48 devstack sudo[91413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:08:48 devstack sudo[91413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:08:49 devstack sudo[91413]: pam_unix(sudo:session): session closed for user root Jul 21 02:08:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.441s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:08:49 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:08:49 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager._thread_info {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:08:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread count: 8 {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 02:08:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread info: [<_MainThread(MainThread, started 135786703114368)>, , , , , , , ] {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 02:08:51 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9dc1e8d3-1feb-40ad-b19c-51a7b1eb4777 tempest-ServerActionsTestOtherA-1081708656 None] Acquiring lock "cinder-28b68324-4639-47fd-be60-96a529fa00a0-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:08:51 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9dc1e8d3-1feb-40ad-b19c-51a7b1eb4777 tempest-ServerActionsTestOtherA-1081708656 None] Lock "cinder-28b68324-4639-47fd-be60-96a529fa00a0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:08:52 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9dc1e8d3-1feb-40ad-b19c-51a7b1eb4777 tempest-ServerActionsTestOtherA-1081708656 None] Acquiring lock "cinder-quobyte-28b68324-4639-47fd-be60-96a529fa00a0" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:08:52 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9dc1e8d3-1feb-40ad-b19c-51a7b1eb4777 tempest-ServerActionsTestOtherA-1081708656 None] Lock "cinder-quobyte-28b68324-4639-47fd-be60-96a529fa00a0" acquired by "delete_volume" :: waited 0.024s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:08:52 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d26fcea-1fbc-4631-831e-563b79b21899]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:08:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9dc1e8d3-1feb-40ad-b19c-51a7b1eb4777 tempest-ServerActionsTestOtherA-1081708656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-28b68324-4639-47fd-be60-96a529fa00a0 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:08:52 devstack sudo[91451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-28b68324-4639-47fd-be60-96a529fa00a0 Jul 21 02:08:52 devstack sudo[91451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:08:52 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a6cf764c-e407-4dab-9b9a-57d05379bc3d tempest-ServerRescueNegativeTestJSON-1821631500 None] Acquiring lock "cinder-896b3140-3699-445c-a0a3-efb26660a851-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:08:52 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a6cf764c-e407-4dab-9b9a-57d05379bc3d tempest-ServerRescueNegativeTestJSON-1821631500 None] Lock "cinder-896b3140-3699-445c-a0a3-efb26660a851-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:08:52 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a6cf764c-e407-4dab-9b9a-57d05379bc3d tempest-ServerRescueNegativeTestJSON-1821631500 None] Acquiring lock "cinder-quobyte-896b3140-3699-445c-a0a3-efb26660a851" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:08:52 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a6cf764c-e407-4dab-9b9a-57d05379bc3d tempest-ServerRescueNegativeTestJSON-1821631500 None] Lock "cinder-quobyte-896b3140-3699-445c-a0a3-efb26660a851" acquired by "delete_volume" :: waited 0.033s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:08:52 devstack sudo[91451]: pam_unix(sudo:session): session closed for user root Jul 21 02:08:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9dc1e8d3-1feb-40ad-b19c-51a7b1eb4777 tempest-ServerActionsTestOtherA-1081708656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-28b68324-4639-47fd-be60-96a529fa00a0" returned: 0 in 0.734s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:08:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9dc1e8d3-1feb-40ad-b19c-51a7b1eb4777 tempest-ServerActionsTestOtherA-1081708656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-28b68324-4639-47fd-be60-96a529fa00a0 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:08:52 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[243bef0b-8040-4101-a5c9-becb38568fa0]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:08:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a6cf764c-e407-4dab-9b9a-57d05379bc3d tempest-ServerRescueNegativeTestJSON-1821631500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-896b3140-3699-445c-a0a3-efb26660a851 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:08:52 devstack sudo[91456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-28b68324-4639-47fd-be60-96a529fa00a0 Jul 21 02:08:52 devstack sudo[91456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:08:53 devstack sudo[91457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-896b3140-3699-445c-a0a3-efb26660a851 Jul 21 02:08:53 devstack sudo[91457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:08:53 devstack sudo[91456]: pam_unix(sudo:session): session closed for user root Jul 21 02:08:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9dc1e8d3-1feb-40ad-b19c-51a7b1eb4777 tempest-ServerActionsTestOtherA-1081708656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-28b68324-4639-47fd-be60-96a529fa00a0" returned: 0 in 0.545s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:08:53 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9dc1e8d3-1feb-40ad-b19c-51a7b1eb4777 tempest-ServerActionsTestOtherA-1081708656 None] Lock "cinder-quobyte-28b68324-4639-47fd-be60-96a529fa00a0" released by "delete_volume" :: held 1.333s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:08:53 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-9dc1e8d3-1feb-40ad-b19c-51a7b1eb4777 tempest-ServerActionsTestOtherA-1081708656 None] Created reservations ['9dcf3964-c07f-45c5-b2fb-144b67e93e9e', '5907d1e1-d831-4b78-a2e7-958c797f1329', 'e207318f-8688-42cc-a66e-0256f0b135d3', '8a249348-be8b-445e-b862-22481b4b5b3b'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:08:53 devstack sudo[91457]: pam_unix(sudo:session): session closed for user root Jul 21 02:08:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a6cf764c-e407-4dab-9b9a-57d05379bc3d tempest-ServerRescueNegativeTestJSON-1821631500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-896b3140-3699-445c-a0a3-efb26660a851" returned: 0 in 0.709s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:08:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a6cf764c-e407-4dab-9b9a-57d05379bc3d tempest-ServerRescueNegativeTestJSON-1821631500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-896b3140-3699-445c-a0a3-efb26660a851 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:08:53 devstack sudo[91464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-896b3140-3699-445c-a0a3-efb26660a851 Jul 21 02:08:53 devstack sudo[91464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:08:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9dc1e8d3-1feb-40ad-b19c-51a7b1eb4777 tempest-ServerActionsTestOtherA-1081708656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:08:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9dc1e8d3-1feb-40ad-b19c-51a7b1eb4777 tempest-ServerActionsTestOtherA-1081708656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:08:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9dc1e8d3-1feb-40ad-b19c-51a7b1eb4777 tempest-ServerActionsTestOtherA-1081708656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:08:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9dc1e8d3-1feb-40ad-b19c-51a7b1eb4777 tempest-ServerActionsTestOtherA-1081708656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:08:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9dc1e8d3-1feb-40ad-b19c-51a7b1eb4777 tempest-ServerActionsTestOtherA-1081708656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:08:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9dc1e8d3-1feb-40ad-b19c-51a7b1eb4777 tempest-ServerActionsTestOtherA-1081708656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:08:53 devstack sudo[91466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:08:53 devstack sudo[91466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:08:54 devstack sudo[91464]: pam_unix(sudo:session): session closed for user root Jul 21 02:08:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a6cf764c-e407-4dab-9b9a-57d05379bc3d tempest-ServerRescueNegativeTestJSON-1821631500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-896b3140-3699-445c-a0a3-efb26660a851" returned: 0 in 0.511s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:08:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a6cf764c-e407-4dab-9b9a-57d05379bc3d tempest-ServerRescueNegativeTestJSON-1821631500 None] Lock "cinder-quobyte-896b3140-3699-445c-a0a3-efb26660a851" released by "delete_volume" :: held 1.304s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:08:54 devstack sudo[91466]: pam_unix(sudo:session): session closed for user root Jul 21 02:08:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9dc1e8d3-1feb-40ad-b19c-51a7b1eb4777 tempest-ServerActionsTestOtherA-1081708656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.431s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:08:54 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-9dc1e8d3-1feb-40ad-b19c-51a7b1eb4777 tempest-ServerActionsTestOtherA-1081708656 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:08:54 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-9dc1e8d3-1feb-40ad-b19c-51a7b1eb4777 tempest-ServerActionsTestOtherA-1081708656 None] Deleted volume successfully. Jul 21 02:08:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9dc1e8d3-1feb-40ad-b19c-51a7b1eb4777 tempest-ServerActionsTestOtherA-1081708656 None] Lock "cinder-28b68324-4639-47fd-be60-96a529fa00a0-delete_volume" released by "delete_volume" :: held 2.238s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:08:54 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-a6cf764c-e407-4dab-9b9a-57d05379bc3d tempest-ServerRescueNegativeTestJSON-1821631500 None] Created reservations ['5dc937d1-dc61-4715-b33f-b8b46709dd8c', 'a9301bc5-f362-4790-9e3e-e8c84caba4ba', 'dbfa9034-5046-4cd5-9e3d-08ba63725b7d', 'a3efd071-17d4-4f2e-b488-f54cf088c80a'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:08:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a6cf764c-e407-4dab-9b9a-57d05379bc3d tempest-ServerRescueNegativeTestJSON-1821631500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:08:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a6cf764c-e407-4dab-9b9a-57d05379bc3d tempest-ServerRescueNegativeTestJSON-1821631500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:08:54 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-a6cf764c-e407-4dab-9b9a-57d05379bc3d tempest-ServerRescueNegativeTestJSON-1821631500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:08:54 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-a6cf764c-e407-4dab-9b9a-57d05379bc3d tempest-ServerRescueNegativeTestJSON-1821631500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:08:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a6cf764c-e407-4dab-9b9a-57d05379bc3d tempest-ServerRescueNegativeTestJSON-1821631500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:08:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a6cf764c-e407-4dab-9b9a-57d05379bc3d tempest-ServerRescueNegativeTestJSON-1821631500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:08:54 devstack sudo[91471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:08:54 devstack sudo[91471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:08:54 devstack sudo[91471]: pam_unix(sudo:session): session closed for user root Jul 21 02:08:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a6cf764c-e407-4dab-9b9a-57d05379bc3d tempest-ServerRescueNegativeTestJSON-1821631500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.535s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:08:54 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-a6cf764c-e407-4dab-9b9a-57d05379bc3d tempest-ServerRescueNegativeTestJSON-1821631500 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:08:54 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-a6cf764c-e407-4dab-9b9a-57d05379bc3d tempest-ServerRescueNegativeTestJSON-1821631500 None] Deleted volume successfully. Jul 21 02:08:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a6cf764c-e407-4dab-9b9a-57d05379bc3d tempest-ServerRescueNegativeTestJSON-1821631500 None] Lock "cinder-896b3140-3699-445c-a0a3-efb26660a851-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:09:04 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:UPDATE=55,cinder:SELECT=59,cinder:INSERT=14,cinder:DELETE=5 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:09:04 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=62,cinder:INSERT=13,cinder:UPDATE=60,cinder:DELETE=3 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:09:17 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=1 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:09:17 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:UPDATE=1 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:09:19 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:09:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] Flow 'volume_create_manager' (eb63933e-75eb-4a73-8121-0766e3c4fb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:09:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb38bf76-63db-4722-a03c-2b9fb1a59c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb38bf76-63db-4722-a03c-2b9fb1a59c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-649753818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a389b80d-b03a-4e36-af60-e20ebd437486,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='60f7175b59a54091baaf273e51c10355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:09:19Z,use_quota=True,user_id='d6dc3ad196874d259980e8524139926f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c51f798-83ef-4b5d-a735-a095a8edd4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c51f798-83ef-4b5d-a735-a095a8edd4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3af4b985-181d-436b-a16a-39c2bf000cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3af4b985-181d-436b-a16a-39c2bf000cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a389b80d-b03a-4e36-af60-e20ebd437486', 'volume_name': 'volume-a389b80d-b03a-4e36-af60-e20ebd437486', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2aeea63-62d6-433d-8e18-e749e1261537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2aeea63-62d6-433d-8e18-e749e1261537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd155c0a-36f4-48ab-9426-e4fc21bfa3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:19 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] Volume a389b80d-b03a-4e36-af60-e20ebd437486: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a389b80d-b03a-4e36-af60-e20ebd437486', 'volume_size': 1} Jul 21 02:09:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:09:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:09:19 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-649753818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a389b80d-b03a-4e36-af60-e20ebd437486,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='60f7175b59a54091baaf273e51c10355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:09:19Z,use_quota=True,user_id='d6dc3ad196874d259980e8524139926f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:09:19 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] Creating volume a389b80d-b03a-4e36-af60-e20ebd437486 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:09:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:09:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:09:19 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:09:19 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:09:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:09:19 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:09:19 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:09:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a389b80d-b03a-4e36-af60-e20ebd437486 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:19 devstack sudo[91580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a389b80d-b03a-4e36-af60-e20ebd437486 1073741824 Jul 21 02:09:19 devstack sudo[91580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:19 devstack sudo[91580]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a389b80d-b03a-4e36-af60-e20ebd437486 1073741824" returned: 0 in 0.646s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a389b80d-b03a-4e36-af60-e20ebd437486 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:19 devstack sudo[91600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a389b80d-b03a-4e36-af60-e20ebd437486 Jul 21 02:09:19 devstack sudo[91600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:20 devstack sudo[91600]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a389b80d-b03a-4e36-af60-e20ebd437486" returned: 0 in 0.325s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:20 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:09:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:09:20 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd155c0a-36f4-48ab-9426-e4fc21bfa3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a389b80d-b03a-4e36-af60-e20ebd437486', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:20 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dac5f7e-c763-4279-a543-b0aee351209d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:20 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] Volume volume-a389b80d-b03a-4e36-af60-e20ebd437486 (a389b80d-b03a-4e36-af60-e20ebd437486): created successfully Jul 21 02:09:20 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dac5f7e-c763-4279-a543-b0aee351209d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:20 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] Flow 'volume_create_manager' (eb63933e-75eb-4a73-8121-0766e3c4fb02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:09:20 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-2a9f14ac-a752-4f69-8848-71bd67f61ef0 req-d7726ffe-749e-45ae-b047-697f3e36bf9d tempest-VolumesGetTestJSON-1810059478 None] Created volume successfully. Jul 21 02:09:21 devstack cinder-volume[87566]: DEBUG cinder.coordination [req-4a0f6e1a-1077-4e95-a30a-dbf981c20c06 req-e7b4ab50-8d03-4575-a8d4-79413d4fc8f6 tempest-VolumesGetTestJSON-1810059478 None] Acquiring lock "cinder-a389b80d-b03a-4e36-af60-e20ebd437486-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:09:21 devstack cinder-volume[87566]: DEBUG cinder.coordination [req-4a0f6e1a-1077-4e95-a30a-dbf981c20c06 req-e7b4ab50-8d03-4575-a8d4-79413d4fc8f6 tempest-VolumesGetTestJSON-1810059478 None] Lock "cinder-a389b80d-b03a-4e36-af60-e20ebd437486-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:09:21 devstack cinder-volume[87566]: DEBUG cinder.coordination [req-4a0f6e1a-1077-4e95-a30a-dbf981c20c06 req-e7b4ab50-8d03-4575-a8d4-79413d4fc8f6 tempest-VolumesGetTestJSON-1810059478 None] Acquiring lock "cinder-quobyte-a389b80d-b03a-4e36-af60-e20ebd437486" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:09:21 devstack cinder-volume[87566]: DEBUG cinder.coordination [req-4a0f6e1a-1077-4e95-a30a-dbf981c20c06 req-e7b4ab50-8d03-4575-a8d4-79413d4fc8f6 tempest-VolumesGetTestJSON-1810059478 None] Lock "cinder-quobyte-a389b80d-b03a-4e36-af60-e20ebd437486" acquired by "delete_volume" :: waited 0.022s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:09:21 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[40947018-cc8b-456a-970c-6a0982c8d0fd]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:09:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-4a0f6e1a-1077-4e95-a30a-dbf981c20c06 req-e7b4ab50-8d03-4575-a8d4-79413d4fc8f6 tempest-VolumesGetTestJSON-1810059478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a389b80d-b03a-4e36-af60-e20ebd437486 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:22 devstack sudo[91610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a389b80d-b03a-4e36-af60-e20ebd437486 Jul 21 02:09:22 devstack sudo[91610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:22 devstack sudo[91610]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-4a0f6e1a-1077-4e95-a30a-dbf981c20c06 req-e7b4ab50-8d03-4575-a8d4-79413d4fc8f6 tempest-VolumesGetTestJSON-1810059478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a389b80d-b03a-4e36-af60-e20ebd437486" returned: 0 in 0.405s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-4a0f6e1a-1077-4e95-a30a-dbf981c20c06 req-e7b4ab50-8d03-4575-a8d4-79413d4fc8f6 tempest-VolumesGetTestJSON-1810059478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a389b80d-b03a-4e36-af60-e20ebd437486 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:22 devstack sudo[91615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a389b80d-b03a-4e36-af60-e20ebd437486 Jul 21 02:09:22 devstack sudo[91615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:22 devstack sudo[91615]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-4a0f6e1a-1077-4e95-a30a-dbf981c20c06 req-e7b4ab50-8d03-4575-a8d4-79413d4fc8f6 tempest-VolumesGetTestJSON-1810059478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a389b80d-b03a-4e36-af60-e20ebd437486" returned: 0 in 0.526s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [req-4a0f6e1a-1077-4e95-a30a-dbf981c20c06 req-e7b4ab50-8d03-4575-a8d4-79413d4fc8f6 tempest-VolumesGetTestJSON-1810059478 None] Lock "cinder-quobyte-a389b80d-b03a-4e36-af60-e20ebd437486" released by "delete_volume" :: held 1.000s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:09:23 devstack cinder-volume[87566]: DEBUG cinder.quota [req-4a0f6e1a-1077-4e95-a30a-dbf981c20c06 req-e7b4ab50-8d03-4575-a8d4-79413d4fc8f6 tempest-VolumesGetTestJSON-1810059478 None] Created reservations ['73dc0057-e1aa-4a3c-8c49-87a4bafb3198', '118d5950-14b7-44f4-b36c-ace1173f2185', '661b7c10-02dc-4664-b987-c59d1f0bb3eb', 'ddebd358-8747-4c01-ad3d-cf8bec7472c2'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:09:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-4a0f6e1a-1077-4e95-a30a-dbf981c20c06 req-e7b4ab50-8d03-4575-a8d4-79413d4fc8f6 tempest-VolumesGetTestJSON-1810059478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:09:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-4a0f6e1a-1077-4e95-a30a-dbf981c20c06 req-e7b4ab50-8d03-4575-a8d4-79413d4fc8f6 tempest-VolumesGetTestJSON-1810059478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:09:23 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [req-4a0f6e1a-1077-4e95-a30a-dbf981c20c06 req-e7b4ab50-8d03-4575-a8d4-79413d4fc8f6 tempest-VolumesGetTestJSON-1810059478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:09:23 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [req-4a0f6e1a-1077-4e95-a30a-dbf981c20c06 req-e7b4ab50-8d03-4575-a8d4-79413d4fc8f6 tempest-VolumesGetTestJSON-1810059478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:09:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-4a0f6e1a-1077-4e95-a30a-dbf981c20c06 req-e7b4ab50-8d03-4575-a8d4-79413d4fc8f6 tempest-VolumesGetTestJSON-1810059478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:09:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-4a0f6e1a-1077-4e95-a30a-dbf981c20c06 req-e7b4ab50-8d03-4575-a8d4-79413d4fc8f6 tempest-VolumesGetTestJSON-1810059478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:23 devstack sudo[91668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:09:23 devstack sudo[91668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:23 devstack sudo[91668]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-4a0f6e1a-1077-4e95-a30a-dbf981c20c06 req-e7b4ab50-8d03-4575-a8d4-79413d4fc8f6 tempest-VolumesGetTestJSON-1810059478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.638s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:23 devstack cinder-volume[87566]: DEBUG cinder.manager [req-4a0f6e1a-1077-4e95-a30a-dbf981c20c06 req-e7b4ab50-8d03-4575-a8d4-79413d4fc8f6 tempest-VolumesGetTestJSON-1810059478 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:09:23 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-4a0f6e1a-1077-4e95-a30a-dbf981c20c06 req-e7b4ab50-8d03-4575-a8d4-79413d4fc8f6 tempest-VolumesGetTestJSON-1810059478 None] Deleted volume successfully. Jul 21 02:09:23 devstack cinder-volume[87566]: DEBUG cinder.coordination [req-4a0f6e1a-1077-4e95-a30a-dbf981c20c06 req-e7b4ab50-8d03-4575-a8d4-79413d4fc8f6 tempest-VolumesGetTestJSON-1810059478 None] Lock "cinder-a389b80d-b03a-4e36-af60-e20ebd437486-delete_volume" released by "delete_volume" :: held 2.127s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:09:30 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:09:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] Flow 'volume_create_manager' (0a9709ab-0766-4b50-9255-4ceb9a662b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:09:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cefd381-3cdc-493e-b203-0c6d414c61da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cefd381-3cdc-493e-b203-0c6d414c61da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1859172995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e82f943-6eed-4177-8b8f-a6aa20bcff39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b7726f2315646308c82b19ec53148b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:09:30Z,use_quota=True,user_id='eaecc7436d7549c18209acaf2de14287',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52cc93ea-a5ba-4555-aabd-efa79b2cc6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52cc93ea-a5ba-4555-aabd-efa79b2cc6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (050a3973-d50d-468f-b0f7-793c52e58e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (050a3973-d50d-468f-b0f7-793c52e58e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e82f943-6eed-4177-8b8f-a6aa20bcff39', 'volume_name': 'volume-7e82f943-6eed-4177-8b8f-a6aa20bcff39', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f420243-d77d-4043-8d92-5913b5936731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f420243-d77d-4043-8d92-5913b5936731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5abef29-4afc-48e7-ab58-45e4cfa7686a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:30 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] Volume 7e82f943-6eed-4177-8b8f-a6aa20bcff39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e82f943-6eed-4177-8b8f-a6aa20bcff39', 'volume_size': 1} Jul 21 02:09:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:09:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:09:30 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1859172995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e82f943-6eed-4177-8b8f-a6aa20bcff39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b7726f2315646308c82b19ec53148b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:09:30Z,use_quota=True,user_id='eaecc7436d7549c18209acaf2de14287',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:09:30 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] Creating volume 7e82f943-6eed-4177-8b8f-a6aa20bcff39 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:09:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:09:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:09:30 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:09:30 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:09:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:09:30 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:09:30 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:09:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7e82f943-6eed-4177-8b8f-a6aa20bcff39 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:30 devstack sudo[91698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7e82f943-6eed-4177-8b8f-a6aa20bcff39 1073741824 Jul 21 02:09:30 devstack sudo[91698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:31 devstack sudo[91698]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7e82f943-6eed-4177-8b8f-a6aa20bcff39 1073741824" returned: 0 in 0.970s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7e82f943-6eed-4177-8b8f-a6aa20bcff39 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:31 devstack sudo[91705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7e82f943-6eed-4177-8b8f-a6aa20bcff39 Jul 21 02:09:31 devstack sudo[91705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:31 devstack sudo[91705]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7e82f943-6eed-4177-8b8f-a6aa20bcff39" returned: 0 in 0.467s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:31 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:09:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:09:31 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5abef29-4afc-48e7-ab58-45e4cfa7686a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e82f943-6eed-4177-8b8f-a6aa20bcff39', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:31 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9aade9-5711-4e08-87db-5eb64d830360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:31 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] Volume volume-7e82f943-6eed-4177-8b8f-a6aa20bcff39 (7e82f943-6eed-4177-8b8f-a6aa20bcff39): created successfully Jul 21 02:09:31 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9aade9-5711-4e08-87db-5eb64d830360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:31 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] Flow 'volume_create_manager' (0a9709ab-0766-4b50-9255-4ceb9a662b98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:09:31 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-da84b394-092b-406d-a772-f94dcea4dc31 tempest-VolumeQuotasAdminTestJSON-334002500 None] Created volume successfully. Jul 21 02:09:32 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f75d11b3-ab07-4023-9439-1cf94f26c507 tempest-VolumeQuotasAdminTestJSON-334002500 None] Acquiring lock "cinder-7e82f943-6eed-4177-8b8f-a6aa20bcff39-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:09:32 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f75d11b3-ab07-4023-9439-1cf94f26c507 tempest-VolumeQuotasAdminTestJSON-334002500 None] Lock "cinder-7e82f943-6eed-4177-8b8f-a6aa20bcff39-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:09:32 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f75d11b3-ab07-4023-9439-1cf94f26c507 tempest-VolumeQuotasAdminTestJSON-334002500 None] Acquiring lock "cinder-quobyte-7e82f943-6eed-4177-8b8f-a6aa20bcff39" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:09:32 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f75d11b3-ab07-4023-9439-1cf94f26c507 tempest-VolumeQuotasAdminTestJSON-334002500 None] Lock "cinder-quobyte-7e82f943-6eed-4177-8b8f-a6aa20bcff39" acquired by "delete_volume" :: waited 0.060s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:09:32 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a7f053-d35f-47fa-b539-4e02f5c4522d]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:09:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f75d11b3-ab07-4023-9439-1cf94f26c507 tempest-VolumeQuotasAdminTestJSON-334002500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7e82f943-6eed-4177-8b8f-a6aa20bcff39 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:32 devstack sudo[91722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7e82f943-6eed-4177-8b8f-a6aa20bcff39 Jul 21 02:09:32 devstack sudo[91722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:33 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-2101799f-3ac7-41b5-8a96-279aa19fcc40 tempest-GroupSnapshotsTest-1636033596 None] Group tempest-GroupSnapshotsTest-Group-1785444268: creating Jul 21 02:09:33 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-2101799f-3ac7-41b5-8a96-279aa19fcc40 tempest-GroupSnapshotsTest-1636033596 None] Group tempest-GroupSnapshotsTest-Group-1785444268: created successfully Jul 21 02:09:33 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-2101799f-3ac7-41b5-8a96-279aa19fcc40 tempest-GroupSnapshotsTest-1636033596 None] Create group completed successfully. Jul 21 02:09:33 devstack sudo[91722]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f75d11b3-ab07-4023-9439-1cf94f26c507 tempest-VolumeQuotasAdminTestJSON-334002500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7e82f943-6eed-4177-8b8f-a6aa20bcff39" returned: 0 in 0.636s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f75d11b3-ab07-4023-9439-1cf94f26c507 tempest-VolumeQuotasAdminTestJSON-334002500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7e82f943-6eed-4177-8b8f-a6aa20bcff39 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:33 devstack sudo[91730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7e82f943-6eed-4177-8b8f-a6aa20bcff39 Jul 21 02:09:33 devstack sudo[91730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:33 devstack sudo[91730]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f75d11b3-ab07-4023-9439-1cf94f26c507 tempest-VolumeQuotasAdminTestJSON-334002500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7e82f943-6eed-4177-8b8f-a6aa20bcff39" returned: 0 in 0.331s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:33 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f75d11b3-ab07-4023-9439-1cf94f26c507 tempest-VolumeQuotasAdminTestJSON-334002500 None] Lock "cinder-quobyte-7e82f943-6eed-4177-8b8f-a6aa20bcff39" released by "delete_volume" :: held 1.026s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:09:33 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-f75d11b3-ab07-4023-9439-1cf94f26c507 tempest-VolumeQuotasAdminTestJSON-334002500 None] Created reservations ['1b7bbb15-da02-48ad-858f-81248b650871', '0fb147ff-b36e-45ea-88d7-a3a07578f49b', '9af8842c-8b4d-4c6d-81fd-cdbe8410e6fd', 'a10dc0a4-218d-4cc0-a022-aec657f8c221'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:09:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f75d11b3-ab07-4023-9439-1cf94f26c507 tempest-VolumeQuotasAdminTestJSON-334002500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:09:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f75d11b3-ab07-4023-9439-1cf94f26c507 tempest-VolumeQuotasAdminTestJSON-334002500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:09:33 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f75d11b3-ab07-4023-9439-1cf94f26c507 tempest-VolumeQuotasAdminTestJSON-334002500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:09:33 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f75d11b3-ab07-4023-9439-1cf94f26c507 tempest-VolumeQuotasAdminTestJSON-334002500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:09:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f75d11b3-ab07-4023-9439-1cf94f26c507 tempest-VolumeQuotasAdminTestJSON-334002500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:09:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f75d11b3-ab07-4023-9439-1cf94f26c507 tempest-VolumeQuotasAdminTestJSON-334002500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:33 devstack sudo[91733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:09:33 devstack sudo[91733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:34 devstack sudo[91733]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f75d11b3-ab07-4023-9439-1cf94f26c507 tempest-VolumeQuotasAdminTestJSON-334002500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.403s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:34 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-f75d11b3-ab07-4023-9439-1cf94f26c507 tempest-VolumeQuotasAdminTestJSON-334002500 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:09:34 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-f75d11b3-ab07-4023-9439-1cf94f26c507 tempest-VolumeQuotasAdminTestJSON-334002500 None] Deleted volume successfully. Jul 21 02:09:34 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f75d11b3-ab07-4023-9439-1cf94f26c507 tempest-VolumeQuotasAdminTestJSON-334002500 None] Lock "cinder-7e82f943-6eed-4177-8b8f-a6aa20bcff39-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:09:35 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:09:35 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] Flow 'volume_create_manager' (cdcd2b91-22aa-42dd-8991-4d4e89af99c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:09:35 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b232a851-01bc-4765-a489-13a68a091b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:35 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b232a851-01bc-4765-a489-13a68a091b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-676719811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d801bef1-5c7d-405c-aea0-b7ae874cd9a3,host='devstack@QuobyteHD#QuobyteHD',id=a79132c4-2037-4104-8f67-ba9dc5b59d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284ae0621ccc49438147ad22d0766a68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:09:35Z,use_quota=True,user_id='89ff5de8c8bc4e9f886a366cf52aed8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(16ea279f-ae64-4c63-9ac8-a62065e30b31),volume_type_id=16ea279f-ae64-4c63-9ac8-a62065e30b31)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:35 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5315cc79-b2b2-405f-9d64-3e10e4866373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:35 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5315cc79-b2b2-405f-9d64-3e10e4866373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:35 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f00e3c-206a-4ee0-9945-ea07214ec49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:35 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f00e3c-206a-4ee0-9945-ea07214ec49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a79132c4-2037-4104-8f67-ba9dc5b59d64', 'volume_name': 'volume-a79132c4-2037-4104-8f67-ba9dc5b59d64', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:35 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35797f4b-23d0-4c31-890c-7f08b696a6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:35 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35797f4b-23d0-4c31-890c-7f08b696a6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:35 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a02f6e-b221-4616-8157-e42d22524df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:35 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] Volume a79132c4-2037-4104-8f67-ba9dc5b59d64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a79132c4-2037-4104-8f67-ba9dc5b59d64', 'volume_size': 1} Jul 21 02:09:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:09:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:09:35 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d801bef1-5c7d-405c-aea0-b7ae874cd9a3,created_at=2026-07-21T00:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-676719811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d801bef1-5c7d-405c-aea0-b7ae874cd9a3,host='devstack@QuobyteHD#QuobyteHD',id=a79132c4-2037-4104-8f67-ba9dc5b59d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284ae0621ccc49438147ad22d0766a68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:09:35Z,use_quota=True,user_id='89ff5de8c8bc4e9f886a366cf52aed8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(16ea279f-ae64-4c63-9ac8-a62065e30b31),volume_type_id=16ea279f-ae64-4c63-9ac8-a62065e30b31)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:09:35 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] Creating volume a79132c4-2037-4104-8f67-ba9dc5b59d64 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:09:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:09:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:09:35 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:09:35 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:09:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:09:35 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:09:35 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:09:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:35 devstack sudo[91741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64 1073741824 Jul 21 02:09:35 devstack sudo[91741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:35 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:09:35 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] Flow 'volume_create_manager' (f26f4f2d-11a0-496c-bc30-1e31bf95b5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:09:35 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7375fcf8-194b-4655-8606-22c0fcb692e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:36 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7375fcf8-194b-4655-8606-22c0fcb692e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-908591640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93b7f461-b392-4143-bc3d-e82a851c1b3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b7726f2315646308c82b19ec53148b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:09:36Z,use_quota=True,user_id='eaecc7436d7549c18209acaf2de14287',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:36 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b45bae-3da1-469d-a092-071cbed8a8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:36 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b45bae-3da1-469d-a092-071cbed8a8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:36 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f25743-88d5-4819-94b2-ac222000ebff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:36 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f25743-88d5-4819-94b2-ac222000ebff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93b7f461-b392-4143-bc3d-e82a851c1b3e', 'volume_name': 'volume-93b7f461-b392-4143-bc3d-e82a851c1b3e', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:36 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63679e91-3f5a-466c-9c68-ac87059ca229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:36 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63679e91-3f5a-466c-9c68-ac87059ca229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:36 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a50e31-8025-4b4e-977a-0628ab51713d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:36 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] Volume 93b7f461-b392-4143-bc3d-e82a851c1b3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93b7f461-b392-4143-bc3d-e82a851c1b3e', 'volume_size': 1} Jul 21 02:09:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:09:36 devstack sudo[91741]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64 1073741824" returned: 0 in 1.256s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:36 devstack sudo[91785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64 Jul 21 02:09:36 devstack sudo[91785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:37 devstack sudo[91785]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64" returned: 0 in 0.568s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:37 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] <== create_volume: return (1925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:09:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.931s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:09:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.040s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:09:37 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-908591640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93b7f461-b392-4143-bc3d-e82a851c1b3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b7726f2315646308c82b19ec53148b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:09:36Z,use_quota=True,user_id='eaecc7436d7549c18209acaf2de14287',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:09:37 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] Creating volume 93b7f461-b392-4143-bc3d-e82a851c1b3e {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:09:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:09:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:09:37 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:09:37 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:09:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:09:37 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:09:37 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:09:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-93b7f461-b392-4143-bc3d-e82a851c1b3e 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a02f6e-b221-4616-8157-e42d22524df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a79132c4-2037-4104-8f67-ba9dc5b59d64', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:37 devstack sudo[91812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-93b7f461-b392-4143-bc3d-e82a851c1b3e 1073741824 Jul 21 02:09:37 devstack sudo[91812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (284aeb10-7f2e-4ba4-bc32-ec1f8852364f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:37 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] Volume volume-a79132c4-2037-4104-8f67-ba9dc5b59d64 (a79132c4-2037-4104-8f67-ba9dc5b59d64): created successfully Jul 21 02:09:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (284aeb10-7f2e-4ba4-bc32-ec1f8852364f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] Flow 'volume_create_manager' (cdcd2b91-22aa-42dd-8991-4d4e89af99c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:09:37 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-4cbf18a0-9f00-4b17-a11f-613284cb7f61 tempest-GroupSnapshotsTest-1636033596 None] Created volume successfully. Jul 21 02:09:38 devstack sudo[91812]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-93b7f461-b392-4143-bc3d-e82a851c1b3e 1073741824" returned: 0 in 0.859s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-93b7f461-b392-4143-bc3d-e82a851c1b3e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:38 devstack sudo[91819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-93b7f461-b392-4143-bc3d-e82a851c1b3e Jul 21 02:09:38 devstack sudo[91819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:38 devstack sudo[91819]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-93b7f461-b392-4143-bc3d-e82a851c1b3e" returned: 0 in 0.467s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:38 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:09:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:09:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a50e31-8025-4b4e-977a-0628ab51713d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93b7f461-b392-4143-bc3d-e82a851c1b3e', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51473793-6775-473f-b81e-43b385c44d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:38 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] Volume volume-93b7f461-b392-4143-bc3d-e82a851c1b3e (93b7f461-b392-4143-bc3d-e82a851c1b3e): created successfully Jul 21 02:09:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51473793-6775-473f-b81e-43b385c44d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] Flow 'volume_create_manager' (f26f4f2d-11a0-496c-bc30-1e31bf95b5f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:09:38 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-ba6fff23-10bc-4695-a171-046d0edde881 tempest-VolumeQuotasAdminTestJSON-334002500 None] Created volume successfully. Jul 21 02:09:38 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-0edf29fc-9193-42ff-a629-fef960f5ad26 tempest-GroupSnapshotsTest-1636033596 None] GroupSnapshot 7774bac4-029f-4a7e-a52a-7a4058fd7517: creating. Jul 21 02:09:39 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0edf29fc-9193-42ff-a629-fef960f5ad26 tempest-GroupSnapshotsTest-1636033596 None] Group snapshot 7774bac4-029f-4a7e-a52a-7a4058fd7517: creating. {{(pid=87566) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 21 02:09:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0edf29fc-9193-42ff-a629-fef960f5ad26 tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:09:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0edf29fc-9193-42ff-a629-fef960f5ad26 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:09:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-0edf29fc-9193-42ff-a629-fef960f5ad26 tempest-GroupSnapshotsTest-1636033596 None] Creating offline snapshot cd6dfef6-9b61-4ca2-ada9-52700297ebb8 of volume a79132c4-2037-4104-8f67-ba9dc5b59d64 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:09:39 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[c468ae01-f49c-4f2e-83c5-6cd494d3511a]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:09:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0edf29fc-9193-42ff-a629-fef960f5ad26 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:39 devstack sudo[91835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64 Jul 21 02:09:39 devstack sudo[91835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:40 devstack sudo[91835]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0edf29fc-9193-42ff-a629-fef960f5ad26 tempest-GroupSnapshotsTest-1636033596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64" returned: 0 in 1.014s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0edf29fc-9193-42ff-a629-fef960f5ad26 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64.cd6dfef6-9b61-4ca2-ada9-52700297ebb8 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:40 devstack sudo[91847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64.cd6dfef6-9b61-4ca2-ada9-52700297ebb8 1G Jul 21 02:09:40 devstack sudo[91847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:40 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-b4428d27-54ec-4490-8663-e2bd4426462e tempest-VolumeQuotasAdminTestJSON-1040279679 None] Transfer volume completed successfully. Jul 21 02:09:41 devstack sudo[91847]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0edf29fc-9193-42ff-a629-fef960f5ad26 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64.cd6dfef6-9b61-4ca2-ada9-52700297ebb8 1G" returned: 0 in 0.843s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0edf29fc-9193-42ff-a629-fef960f5ad26 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a79132c4-2037-4104-8f67-ba9dc5b59d64 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64.cd6dfef6-9b61-4ca2-ada9-52700297ebb8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:41 devstack sudo[91864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a79132c4-2037-4104-8f67-ba9dc5b59d64 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64.cd6dfef6-9b61-4ca2-ada9-52700297ebb8 Jul 21 02:09:41 devstack sudo[91864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:41 devstack sudo[91864]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0edf29fc-9193-42ff-a629-fef960f5ad26 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a79132c4-2037-4104-8f67-ba9dc5b59d64 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64.cd6dfef6-9b61-4ca2-ada9-52700297ebb8" returned: 0 in 0.526s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:41 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-0edf29fc-9193-42ff-a629-fef960f5ad26 tempest-GroupSnapshotsTest-1636033596 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64.cd6dfef6-9b61-4ca2-ada9-52700297ebb8 is being set with open permissions: ugo+rw: NotImplementedError Jul 21 02:09:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0edf29fc-9193-42ff-a629-fef960f5ad26 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64.cd6dfef6-9b61-4ca2-ada9-52700297ebb8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:41 devstack sudo[91884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64.cd6dfef6-9b61-4ca2-ada9-52700297ebb8 Jul 21 02:09:41 devstack sudo[91884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:41 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a529c67d-6a0a-4970-87c1-746207d6ba90 tempest-VolumeQuotasAdminTestJSON-20388849 None] Acquiring lock "cinder-93b7f461-b392-4143-bc3d-e82a851c1b3e-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:09:41 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a529c67d-6a0a-4970-87c1-746207d6ba90 tempest-VolumeQuotasAdminTestJSON-20388849 None] Lock "cinder-93b7f461-b392-4143-bc3d-e82a851c1b3e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:09:41 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a529c67d-6a0a-4970-87c1-746207d6ba90 tempest-VolumeQuotasAdminTestJSON-20388849 None] Acquiring lock "cinder-quobyte-93b7f461-b392-4143-bc3d-e82a851c1b3e" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:09:41 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a529c67d-6a0a-4970-87c1-746207d6ba90 tempest-VolumeQuotasAdminTestJSON-20388849 None] Lock "cinder-quobyte-93b7f461-b392-4143-bc3d-e82a851c1b3e" acquired by "delete_volume" :: waited 0.021s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:09:41 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e18295e-701b-46b8-8621-50e85ecbdc03]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:09:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a529c67d-6a0a-4970-87c1-746207d6ba90 tempest-VolumeQuotasAdminTestJSON-20388849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-93b7f461-b392-4143-bc3d-e82a851c1b3e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:41 devstack sudo[91886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-93b7f461-b392-4143-bc3d-e82a851c1b3e Jul 21 02:09:41 devstack sudo[91886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:42 devstack sudo[91884]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0edf29fc-9193-42ff-a629-fef960f5ad26 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64.cd6dfef6-9b61-4ca2-ada9-52700297ebb8" returned: 0 in 0.468s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0edf29fc-9193-42ff-a629-fef960f5ad26 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:42 devstack sudo[91892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64.info Jul 21 02:09:42 devstack sudo[91892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:42 devstack sudo[91886]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a529c67d-6a0a-4970-87c1-746207d6ba90 tempest-VolumeQuotasAdminTestJSON-20388849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-93b7f461-b392-4143-bc3d-e82a851c1b3e" returned: 0 in 0.568s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a529c67d-6a0a-4970-87c1-746207d6ba90 tempest-VolumeQuotasAdminTestJSON-20388849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-93b7f461-b392-4143-bc3d-e82a851c1b3e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:42 devstack sudo[91900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-93b7f461-b392-4143-bc3d-e82a851c1b3e Jul 21 02:09:42 devstack sudo[91900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:42 devstack sudo[91892]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0edf29fc-9193-42ff-a629-fef960f5ad26 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64.info" returned: 0 in 0.405s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:42 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-0edf29fc-9193-42ff-a629-fef960f5ad26 tempest-GroupSnapshotsTest-1636033596 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 02:09:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0edf29fc-9193-42ff-a629-fef960f5ad26 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:42 devstack sudo[91903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64.info Jul 21 02:09:42 devstack sudo[91903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:42 devstack sudo[91900]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a529c67d-6a0a-4970-87c1-746207d6ba90 tempest-VolumeQuotasAdminTestJSON-20388849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-93b7f461-b392-4143-bc3d-e82a851c1b3e" returned: 0 in 0.317s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:42 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a529c67d-6a0a-4970-87c1-746207d6ba90 tempest-VolumeQuotasAdminTestJSON-20388849 None] Lock "cinder-quobyte-93b7f461-b392-4143-bc3d-e82a851c1b3e" released by "delete_volume" :: held 0.944s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:09:42 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-a529c67d-6a0a-4970-87c1-746207d6ba90 tempest-VolumeQuotasAdminTestJSON-20388849 None] Created reservations ['c44812ea-4469-4e03-ba4f-b81c82f566b4', '5c56ff06-8678-4355-aa5a-d55eb66e0a41', 'd3b7143b-0ee7-4849-b464-d3c03fc334c2', '8ae58326-ffd9-4b10-859d-3b42acfe4ee5'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:09:42 devstack sudo[91903]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0edf29fc-9193-42ff-a629-fef960f5ad26 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64.info" returned: 0 in 0.326s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0edf29fc-9193-42ff-a629-fef960f5ad26 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.750s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:09:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a529c67d-6a0a-4970-87c1-746207d6ba90 tempest-VolumeQuotasAdminTestJSON-20388849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:09:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a529c67d-6a0a-4970-87c1-746207d6ba90 tempest-VolumeQuotasAdminTestJSON-20388849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:09:42 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-a529c67d-6a0a-4970-87c1-746207d6ba90 tempest-VolumeQuotasAdminTestJSON-20388849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:09:42 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-a529c67d-6a0a-4970-87c1-746207d6ba90 tempest-VolumeQuotasAdminTestJSON-20388849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:09:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a529c67d-6a0a-4970-87c1-746207d6ba90 tempest-VolumeQuotasAdminTestJSON-20388849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:09:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a529c67d-6a0a-4970-87c1-746207d6ba90 tempest-VolumeQuotasAdminTestJSON-20388849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:42 devstack sudo[91907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:09:42 devstack sudo[91907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:43 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-0edf29fc-9193-42ff-a629-fef960f5ad26 tempest-GroupSnapshotsTest-1636033596 None] group_snapshot 7774bac4-029f-4a7e-a52a-7a4058fd7517: created successfully Jul 21 02:09:43 devstack sudo[91907]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a529c67d-6a0a-4970-87c1-746207d6ba90 tempest-VolumeQuotasAdminTestJSON-20388849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.532s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:43 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-a529c67d-6a0a-4970-87c1-746207d6ba90 tempest-VolumeQuotasAdminTestJSON-20388849 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:09:43 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-a529c67d-6a0a-4970-87c1-746207d6ba90 tempest-VolumeQuotasAdminTestJSON-20388849 None] Deleted volume successfully. Jul 21 02:09:43 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a529c67d-6a0a-4970-87c1-746207d6ba90 tempest-VolumeQuotasAdminTestJSON-20388849 None] Lock "cinder-93b7f461-b392-4143-bc3d-e82a851c1b3e-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:09:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:09:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:09:45 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "cinder-quobyte-cd6dfef6-9b61-4ca2-ada9-52700297ebb8-17e18758-73c0-4a27-acba-847e23eff311" by "_create_volume_from_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:09:45 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:09:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] Flow 'volume_create_manager' (9e37efda-4b54-404e-9cab-aedda716828b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:09:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (904d1694-7642-4574-9875-8493069a458f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (904d1694-7642-4574-9875-8493069a458f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1942041511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d862213-67e8-499d-833e-816a76720e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77ebae38e9b464ea91cf1e140bd58b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:09:45Z,use_quota=True,user_id='abd9853f8bb84ac39dc3855fbcfef441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a73a050-2304-4898-97bd-f70e232b876d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a73a050-2304-4898-97bd-f70e232b876d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e4232b0-ba10-4325-8fd4-e62f4d4bb8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e4232b0-ba10-4325-8fd4-e62f4d4bb8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d862213-67e8-499d-833e-816a76720e52', 'volume_name': 'volume-5d862213-67e8-499d-833e-816a76720e52', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6d67467-554a-4003-a3e6-c05ff4981ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6d67467-554a-4003-a3e6-c05ff4981ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d9dd031-20cd-4ac5-8f12-0e41d7fa28f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:46 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] Volume 5d862213-67e8-499d-833e-816a76720e52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d862213-67e8-499d-833e-816a76720e52', 'volume_size': 1} Jul 21 02:09:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:09:46 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] Lock "cinder-quobyte-cd6dfef6-9b61-4ca2-ada9-52700297ebb8-17e18758-73c0-4a27-acba-847e23eff311" acquired by "_create_volume_from_snapshot" :: waited 0.524s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:09:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] Creating volume 17e18758-73c0-4a27-acba-847e23eff311 from snapshot cd6dfef6-9b61-4ca2-ada9-52700297ebb8 {{(pid=87566) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 02:09:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:09:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:09:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:09:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:09:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:09:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:09:46 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "cinder-quobyte-17e18758-73c0-4a27-acba-847e23eff311" by "_copy_volume_from_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:09:46 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] Lock "cinder-quobyte-17e18758-73c0-4a27-acba-847e23eff311" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:09:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] snapshot: cd6dfef6-9b61-4ca2-ada9-52700297ebb8, volume: 17e18758-73c0-4a27-acba-847e23eff311, {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 02:09:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:09:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:09:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:09:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:09:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:09:46 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[0020acfe-42a9-41ad-b29e-a81056b56562]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:09:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64.cd6dfef6-9b61-4ca2-ada9-52700297ebb8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:46 devstack sudo[92015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64.cd6dfef6-9b61-4ca2-ada9-52700297ebb8 Jul 21 02:09:46 devstack sudo[92015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:46 devstack sudo[92015]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64.cd6dfef6-9b61-4ca2-ada9-52700297ebb8" returned: 0 in 0.446s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a79132c4-2037-4104-8f67-ba9dc5b59d64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:09:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64 {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 02:09:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] Creating direct copy from snapshot {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 02:09:46 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[6360efa5-a4be-4c14-ae10-069f8b1b2b8b]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:09:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:46 devstack sudo[92020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64 Jul 21 02:09:46 devstack sudo[92020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:47 devstack sudo[92020]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64" returned: 0 in 0.526s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:47 devstack cinder-volume[87566]: DEBUG cinder.utils [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] Path /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-17e18758-73c0-4a27-acba-847e23eff311 not found in is_blk_device check {{(pid=87566) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 02:09:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-17e18758-73c0-4a27-acba-847e23eff311 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:47 devstack sudo[92025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-17e18758-73c0-4a27-acba-847e23eff311 Jul 21 02:09:47 devstack sudo[92025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:48 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:09:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:09:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:09:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:09:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:09:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:09:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:48 devstack sudo[92051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:09:48 devstack sudo[92051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:49 devstack sudo[92051]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.844s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:49 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:09:49 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager._thread_info {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:09:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread count: 8 {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 02:09:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread info: [<_MainThread(MainThread, started 135786703114368)>, , , , , , , ] {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 02:09:55 devstack sudo[92025]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-17e18758-73c0-4a27-acba-847e23eff311" returned: 0 in 7.816s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:55 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[b298435d-45ce-4431-ae35-2b46036499df]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:09:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:55 devstack sudo[92061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64 Jul 21 02:09:55 devstack sudo[92061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:55 devstack sudo[92061]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64" returned: 0 in 0.591s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:55 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] Image conversion details: src /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64, size 1024.00 MB, duration 7.82 sec, destination /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-17e18758-73c0-4a27-acba-847e23eff311 {{(pid=87566) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 02:09:55 devstack cinder-volume[87566]: INFO cinder.image.image_utils [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] Converted 1024.00 MB image at 130.95 MB/s Jul 21 02:09:55 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-17e18758-73c0-4a27-acba-847e23eff311 is being set with open permissions: ugo+rw: NotImplementedError Jul 21 02:09:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-17e18758-73c0-4a27-acba-847e23eff311 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:55 devstack sudo[92066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-17e18758-73c0-4a27-acba-847e23eff311 Jul 21 02:09:55 devstack sudo[92066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:55 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=32,cinder:UPDATE=39,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:09:56 devstack sudo[92066]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-17e18758-73c0-4a27-acba-847e23eff311" returned: 0 in 0.295s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:56 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] Lock "cinder-quobyte-17e18758-73c0-4a27-acba-847e23eff311" released by "_copy_volume_from_snapshot" :: held 9.871s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:09:56 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] Lock "cinder-quobyte-cd6dfef6-9b61-4ca2-ada9-52700297ebb8-17e18758-73c0-4a27-acba-847e23eff311" released by "_create_volume_from_snapshot" :: held 9.933s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:09:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.459s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:09:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.938s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:09:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1942041511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d862213-67e8-499d-833e-816a76720e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77ebae38e9b464ea91cf1e140bd58b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:09:45Z,use_quota=True,user_id='abd9853f8bb84ac39dc3855fbcfef441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:09:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] Creating volume 5d862213-67e8-499d-833e-816a76720e52 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:09:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:09:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:09:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:09:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:09:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:09:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:09:56 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:09:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5d862213-67e8-499d-833e-816a76720e52 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:56 devstack sudo[92069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5d862213-67e8-499d-833e-816a76720e52 1073741824 Jul 21 02:09:56 devstack sudo[92069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:56 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-f130d40b-ecdc-42ee-8f5c-45bf458876f7 tempest-GroupSnapshotsTest-1636033596 None] Create group from source-snapshot-7774bac4-029f-4a7e-a52a-7a4058fd7517 completed successfully. Jul 21 02:09:56 devstack sudo[92069]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5d862213-67e8-499d-833e-816a76720e52 1073741824" returned: 0 in 0.506s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5d862213-67e8-499d-833e-816a76720e52 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:56 devstack sudo[92075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5d862213-67e8-499d-833e-816a76720e52 Jul 21 02:09:56 devstack sudo[92075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:56 devstack sudo[92075]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5d862213-67e8-499d-833e-816a76720e52" returned: 0 in 0.318s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:09:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:09:57 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d9dd031-20cd-4ac5-8f12-0e41d7fa28f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d862213-67e8-499d-833e-816a76720e52', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:57 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e739dfe7-09e2-4eca-a998-9533bbad0263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:57 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] Volume volume-5d862213-67e8-499d-833e-816a76720e52 (5d862213-67e8-499d-833e-816a76720e52): created successfully Jul 21 02:09:57 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e739dfe7-09e2-4eca-a998-9533bbad0263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:57 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] Flow 'volume_create_manager' (9e37efda-4b54-404e-9cab-aedda716828b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:09:57 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-29a1beaf-576b-4514-b543-81d6799ef8b3 tempest-ServersNegativeTestJSON-1782234973 None] Created volume successfully. Jul 21 02:09:57 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f0fe2f18-4744-4355-a78d-8f74519b0754 tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "cinder-quobyte-17e18758-73c0-4a27-acba-847e23eff311" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:09:57 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f0fe2f18-4744-4355-a78d-8f74519b0754 tempest-GroupSnapshotsTest-1636033596 None] Lock "cinder-quobyte-17e18758-73c0-4a27-acba-847e23eff311" acquired by "delete_volume" :: waited 0.027s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:09:57 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb978c95-e849-46cc-8ae0-7c121d4d8418]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:09:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f0fe2f18-4744-4355-a78d-8f74519b0754 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-17e18758-73c0-4a27-acba-847e23eff311 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:57 devstack sudo[92078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-17e18758-73c0-4a27-acba-847e23eff311 Jul 21 02:09:57 devstack sudo[92078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:57 devstack sudo[92078]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f0fe2f18-4744-4355-a78d-8f74519b0754 tempest-GroupSnapshotsTest-1636033596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-17e18758-73c0-4a27-acba-847e23eff311" returned: 0 in 0.384s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f0fe2f18-4744-4355-a78d-8f74519b0754 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-17e18758-73c0-4a27-acba-847e23eff311 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:57 devstack sudo[92084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-17e18758-73c0-4a27-acba-847e23eff311 Jul 21 02:09:57 devstack sudo[92084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:57 devstack sudo[92084]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f0fe2f18-4744-4355-a78d-8f74519b0754 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-17e18758-73c0-4a27-acba-847e23eff311" returned: 0 in 0.286s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:57 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f0fe2f18-4744-4355-a78d-8f74519b0754 tempest-GroupSnapshotsTest-1636033596 None] Lock "cinder-quobyte-17e18758-73c0-4a27-acba-847e23eff311" released by "delete_volume" :: held 0.718s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:09:58 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-f0fe2f18-4744-4355-a78d-8f74519b0754 tempest-GroupSnapshotsTest-1636033596 None] Created reservations ['fccb0736-0580-4006-b30e-fa200ab6d46d'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:09:58 devstack cinder-volume[87566]: WARNING cinder.quota [None req-f0fe2f18-4744-4355-a78d-8f74519b0754 tempest-GroupSnapshotsTest-1636033596 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-40169491 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-40169491, it is now deprecated. Please use the default quota class for default quota. Jul 21 02:09:58 devstack cinder-volume[87566]: WARNING cinder.quota [None req-f0fe2f18-4744-4355-a78d-8f74519b0754 tempest-GroupSnapshotsTest-1636033596 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-40169491 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-40169491, it is now deprecated. Please use the default quota class for default quota. Jul 21 02:09:58 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-f0fe2f18-4744-4355-a78d-8f74519b0754 tempest-GroupSnapshotsTest-1636033596 None] Created reservations ['df2ce18d-cd36-4304-9177-3ddf4deab788', 'ecc4df1b-57a1-408f-a9bb-45072bab9469', '555f38c7-214e-4b39-801f-58ea6ff799a8', '28ce3088-6c9c-4caf-9826-aff97d1adda7'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:09:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f0fe2f18-4744-4355-a78d-8f74519b0754 tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:09:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f0fe2f18-4744-4355-a78d-8f74519b0754 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:09:58 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f0fe2f18-4744-4355-a78d-8f74519b0754 tempest-GroupSnapshotsTest-1636033596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:09:58 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f0fe2f18-4744-4355-a78d-8f74519b0754 tempest-GroupSnapshotsTest-1636033596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:09:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f0fe2f18-4744-4355-a78d-8f74519b0754 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:09:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f0fe2f18-4744-4355-a78d-8f74519b0754 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:58 devstack sudo[92103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:09:58 devstack sudo[92103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:58 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-6bd79d89-ead2-4c20-9947-883710cda4df tempest-GroupSnapshotsTest-1636033596 None] group_snapshot 7774bac4-029f-4a7e-a52a-7a4058fd7517: deleting Jul 21 02:09:58 devstack sudo[92103]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f0fe2f18-4744-4355-a78d-8f74519b0754 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.290s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:58 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-f0fe2f18-4744-4355-a78d-8f74519b0754 tempest-GroupSnapshotsTest-1636033596 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:09:58 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-f0fe2f18-4744-4355-a78d-8f74519b0754 tempest-GroupSnapshotsTest-1636033596 None] Delete group completed successfully. Jul 21 02:09:58 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6bd79d89-ead2-4c20-9947-883710cda4df tempest-GroupSnapshotsTest-1636033596 None] group_snapshot 7774bac4-029f-4a7e-a52a-7a4058fd7517: deleting {{(pid=87566) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 21 02:09:58 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6bd79d89-ead2-4c20-9947-883710cda4df tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "cinder-quobyte-a79132c4-2037-4104-8f67-ba9dc5b59d64" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:09:58 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6bd79d89-ead2-4c20-9947-883710cda4df tempest-GroupSnapshotsTest-1636033596 None] Lock "cinder-quobyte-a79132c4-2037-4104-8f67-ba9dc5b59d64" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:09:58 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6bd79d89-ead2-4c20-9947-883710cda4df tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "cinder-quobyte-cd6dfef6-9b61-4ca2-ada9-52700297ebb8" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:09:58 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6bd79d89-ead2-4c20-9947-883710cda4df tempest-GroupSnapshotsTest-1636033596 None] Lock "cinder-quobyte-cd6dfef6-9b61-4ca2-ada9-52700297ebb8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:09:58 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-6bd79d89-ead2-4c20-9947-883710cda4df tempest-GroupSnapshotsTest-1636033596 None] Deleting offline snapshot cd6dfef6-9b61-4ca2-ada9-52700297ebb8 of volume a79132c4-2037-4104-8f67-ba9dc5b59d64 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:09:58 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-6bd79d89-ead2-4c20-9947-883710cda4df tempest-GroupSnapshotsTest-1636033596 None] snapshot_file for this snap is: volume-a79132c4-2037-4104-8f67-ba9dc5b59d64.cd6dfef6-9b61-4ca2-ada9-52700297ebb8 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:09:58 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[da18ecc3-78d3-4918-b4af-f1c6b10b445e]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:09:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6bd79d89-ead2-4c20-9947-883710cda4df tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64.cd6dfef6-9b61-4ca2-ada9-52700297ebb8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:58 devstack sudo[92106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64.cd6dfef6-9b61-4ca2-ada9-52700297ebb8 Jul 21 02:09:58 devstack sudo[92106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:09:59 devstack sudo[92106]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] Flow 'volume_create_manager' (d8c5b22b-6709-416d-b35a-55b749022361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4f84ea-eefc-4473-a9db-15e0f64aee9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6bd79d89-ead2-4c20-9947-883710cda4df tempest-GroupSnapshotsTest-1636033596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64.cd6dfef6-9b61-4ca2-ada9-52700297ebb8" returned: 0 in 0.471s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-6bd79d89-ead2-4c20-9947-883710cda4df tempest-GroupSnapshotsTest-1636033596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a79132c4-2037-4104-8f67-ba9dc5b59d64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4f84ea-eefc-4473-a9db-15e0f64aee9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1571804125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b4aa6b2-5ae6-4dc6-a6d8-05f9ccc77db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4c645206a284b269d9d94d4f67065b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:09:59Z,use_quota=True,user_id='2842c5ae95fd48959a41233e77633295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (671bb9f7-fff3-4486-a895-ea60dbb4ac83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (671bb9f7-fff3-4486-a895-ea60dbb4ac83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0601215b-2eb3-4af9-a253-eb265c6f0e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0601215b-2eb3-4af9-a253-eb265c6f0e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b4aa6b2-5ae6-4dc6-a6d8-05f9ccc77db7', 'volume_name': 'volume-0b4aa6b2-5ae6-4dc6-a6d8-05f9ccc77db7', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (430db156-c24f-44e8-adb8-cbe8355a23c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (430db156-c24f-44e8-adb8-cbe8355a23c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca120f5-8086-4ca5-a8d7-77605939bc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:59 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] Volume 0b4aa6b2-5ae6-4dc6-a6d8-05f9ccc77db7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b4aa6b2-5ae6-4dc6-a6d8-05f9ccc77db7', 'volume_size': 1} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1571804125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b4aa6b2-5ae6-4dc6-a6d8-05f9ccc77db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4c645206a284b269d9d94d4f67065b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:09:59Z,use_quota=True,user_id='2842c5ae95fd48959a41233e77633295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] Creating volume 0b4aa6b2-5ae6-4dc6-a6d8-05f9ccc77db7 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:09:59 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0b4aa6b2-5ae6-4dc6-a6d8-05f9ccc77db7 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eadca4a-dc0b-40a5-949a-c5714894e34f]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6bd79d89-ead2-4c20-9947-883710cda4df tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:59 devstack sudo[92111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0b4aa6b2-5ae6-4dc6-a6d8-05f9ccc77db7 1073741824 Jul 21 02:09:59 devstack sudo[92111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:59 devstack sudo[92112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64 Jul 21 02:09:59 devstack sudo[92112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:59 devstack sudo[92112]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6bd79d89-ead2-4c20-9947-883710cda4df tempest-GroupSnapshotsTest-1636033596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64" returned: 0 in 0.444s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6bd79d89-ead2-4c20-9947-883710cda4df tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64.cd6dfef6-9b61-4ca2-ada9-52700297ebb8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:59 devstack sudo[92122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64.cd6dfef6-9b61-4ca2-ada9-52700297ebb8 Jul 21 02:09:59 devstack sudo[92122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:59 devstack sudo[92111]: pam_unix(sudo:session): session closed for user root Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0b4aa6b2-5ae6-4dc6-a6d8-05f9ccc77db7 1073741824" returned: 0 in 0.505s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0b4aa6b2-5ae6-4dc6-a6d8-05f9ccc77db7 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:09:59 devstack sudo[92124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0b4aa6b2-5ae6-4dc6-a6d8-05f9ccc77db7 Jul 21 02:09:59 devstack sudo[92124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] Flow 'volume_create_manager' (2c242dfe-7f62-4285-9f5b-c6f531e28808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (629f4e58-e98e-47b2-966f-0b2599d02bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (629f4e58-e98e-47b2-966f-0b2599d02bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2042083628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d786e16-e070-4f9d-a96b-f560bb315a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77ebae38e9b464ea91cf1e140bd58b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:10:00Z,use_quota=True,user_id='abd9853f8bb84ac39dc3855fbcfef441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7412a829-ab0e-4f3f-ae7e-28cafac58f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7412a829-ab0e-4f3f-ae7e-28cafac58f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0a8ab2f-a220-4028-96d9-d33f34a3b9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0a8ab2f-a220-4028-96d9-d33f34a3b9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d786e16-e070-4f9d-a96b-f560bb315a32', 'volume_name': 'volume-2d786e16-e070-4f9d-a96b-f560bb315a32', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d0b880d-5a0b-4754-a33d-a71c4205eab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d0b880d-5a0b-4754-a33d-a71c4205eab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9cc972b-34a0-431a-be59-868130da2e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:09:59 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] Volume 2d786e16-e070-4f9d-a96b-f560bb315a32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d786e16-e070-4f9d-a96b-f560bb315a32', 'volume_size': 1} Jul 21 02:09:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:10:00 devstack sudo[92122]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6bd79d89-ead2-4c20-9947-883710cda4df tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64.cd6dfef6-9b61-4ca2-ada9-52700297ebb8" returned: 0 in 0.351s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6bd79d89-ead2-4c20-9947-883710cda4df tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64.cd6dfef6-9b61-4ca2-ada9-52700297ebb8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:00 devstack sudo[92124]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0b4aa6b2-5ae6-4dc6-a6d8-05f9ccc77db7" returned: 0 in 0.284s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:00 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:10:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:10:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.158s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:10:00 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2042083628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d786e16-e070-4f9d-a96b-f560bb315a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77ebae38e9b464ea91cf1e140bd58b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:10:00Z,use_quota=True,user_id='abd9853f8bb84ac39dc3855fbcfef441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:10:00 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] Creating volume 2d786e16-e070-4f9d-a96b-f560bb315a32 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:10:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:10:00 devstack sudo[92130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64.cd6dfef6-9b61-4ca2-ada9-52700297ebb8 Jul 21 02:10:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:10:00 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:10:00 devstack sudo[92130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:00 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:10:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:10:00 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:10:00 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:10:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2d786e16-e070-4f9d-a96b-f560bb315a32 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:00 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca120f5-8086-4ca5-a8d7-77605939bc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b4aa6b2-5ae6-4dc6-a6d8-05f9ccc77db7', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:00 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0e30d83-e0f7-4dcd-9412-53b4392012f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:10:00 devstack sudo[92132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2d786e16-e070-4f9d-a96b-f560bb315a32 1073741824 Jul 21 02:10:00 devstack sudo[92132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:00 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] Volume volume-0b4aa6b2-5ae6-4dc6-a6d8-05f9ccc77db7 (0b4aa6b2-5ae6-4dc6-a6d8-05f9ccc77db7): created successfully Jul 21 02:10:00 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0e30d83-e0f7-4dcd-9412-53b4392012f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:00 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] Flow 'volume_create_manager' (d8c5b22b-6709-416d-b35a-55b749022361) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:10:00 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-569598c6-ed5a-4a5d-a550-2f0fdc8cfe95 tempest-VolumeQuotasNegativeTestJSON-449062712 None] Created volume successfully. Jul 21 02:10:00 devstack sudo[92130]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6bd79d89-ead2-4c20-9947-883710cda4df tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64.cd6dfef6-9b61-4ca2-ada9-52700297ebb8" returned: 0 in 0.252s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:00 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6bd79d89-ead2-4c20-9947-883710cda4df tempest-GroupSnapshotsTest-1636033596 None] Lock "cinder-quobyte-cd6dfef6-9b61-4ca2-ada9-52700297ebb8" released by "_delete_snapshot" :: held 1.698s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:10:00 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6bd79d89-ead2-4c20-9947-883710cda4df tempest-GroupSnapshotsTest-1636033596 None] Lock "cinder-quobyte-a79132c4-2037-4104-8f67-ba9dc5b59d64" released by "delete_snapshot" :: held 1.723s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:10:00 devstack cinder-volume[87566]: WARNING cinder.quota [None req-6bd79d89-ead2-4c20-9947-883710cda4df tempest-GroupSnapshotsTest-1636033596 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-40169491 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-40169491, it is now deprecated. Please use the default quota class for default quota. Jul 21 02:10:00 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-6bd79d89-ead2-4c20-9947-883710cda4df tempest-GroupSnapshotsTest-1636033596 None] Created reservations ['47ad358e-f682-4767-8411-8a2ae13df9ce', '86077387-aa21-458d-87af-e081d1721b60', '07b0cf73-2126-43df-8c85-78fa26122937', '082ebbd1-ae61-4a41-8432-aa27c822caa6'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:10:00 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-6bd79d89-ead2-4c20-9947-883710cda4df tempest-GroupSnapshotsTest-1636033596 None] group_snapshot 7774bac4-029f-4a7e-a52a-7a4058fd7517: deleted successfully Jul 21 02:10:00 devstack sudo[92132]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2d786e16-e070-4f9d-a96b-f560bb315a32 1073741824" returned: 0 in 0.461s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2d786e16-e070-4f9d-a96b-f560bb315a32 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:00 devstack sudo[92138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2d786e16-e070-4f9d-a96b-f560bb315a32 Jul 21 02:10:00 devstack sudo[92138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:00 devstack sudo[92138]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2d786e16-e070-4f9d-a96b-f560bb315a32" returned: 0 in 0.257s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:00 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:10:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:10:00 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9cc972b-34a0-431a-be59-868130da2e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d786e16-e070-4f9d-a96b-f560bb315a32', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:00 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ff6424-544a-4cf6-b6da-5afceda1e342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:10:00 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] Volume volume-2d786e16-e070-4f9d-a96b-f560bb315a32 (2d786e16-e070-4f9d-a96b-f560bb315a32): created successfully Jul 21 02:10:00 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ff6424-544a-4cf6-b6da-5afceda1e342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:00 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] Flow 'volume_create_manager' (2c242dfe-7f62-4285-9f5b-c6f531e28808) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:10:00 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-b8df9cde-363e-468f-ba66-6870ba619d5a tempest-ServersNegativeTestJSON-1782234973 None] Created volume successfully. Jul 21 02:10:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c94757d3-d700-4776-9e38-dd4e1d76ec7a tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "cinder-quobyte-a79132c4-2037-4104-8f67-ba9dc5b59d64" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:10:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c94757d3-d700-4776-9e38-dd4e1d76ec7a tempest-GroupSnapshotsTest-1636033596 None] Lock "cinder-quobyte-a79132c4-2037-4104-8f67-ba9dc5b59d64" acquired by "delete_volume" :: waited 0.020s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:10:01 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[579bba8f-f1cf-4da2-a602-48d799c62000]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:10:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c94757d3-d700-4776-9e38-dd4e1d76ec7a tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:01 devstack sudo[92141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64 Jul 21 02:10:01 devstack sudo[92141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:01 devstack sudo[92141]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c94757d3-d700-4776-9e38-dd4e1d76ec7a tempest-GroupSnapshotsTest-1636033596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64" returned: 0 in 0.385s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c94757d3-d700-4776-9e38-dd4e1d76ec7a tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:01 devstack sudo[92146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64 Jul 21 02:10:01 devstack sudo[92146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:01 devstack sudo[92146]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c94757d3-d700-4776-9e38-dd4e1d76ec7a tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79132c4-2037-4104-8f67-ba9dc5b59d64" returned: 0 in 0.290s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c94757d3-d700-4776-9e38-dd4e1d76ec7a tempest-GroupSnapshotsTest-1636033596 None] Lock "cinder-quobyte-a79132c4-2037-4104-8f67-ba9dc5b59d64" released by "delete_volume" :: held 0.760s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:10:02 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-c94757d3-d700-4776-9e38-dd4e1d76ec7a tempest-GroupSnapshotsTest-1636033596 None] Created reservations ['61f33b88-a984-4fa7-b630-c84058426190'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:10:02 devstack cinder-volume[87566]: WARNING cinder.db.api [None req-c94757d3-d700-4776-9e38-dd4e1d76ec7a tempest-GroupSnapshotsTest-1636033596 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-40169491'] Jul 21 02:10:02 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-c94757d3-d700-4776-9e38-dd4e1d76ec7a tempest-GroupSnapshotsTest-1636033596 None] Created reservations ['b7a2cd37-fa9b-43d3-9dd3-f8e4dd4d763d', '0b03a939-2212-4a6a-9f24-a36ab0a29512', '49088b6b-5afe-4194-aa69-e46fe5e05b38', '37089fcc-4bfb-4366-9727-9a5dd2c84716'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:10:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c94757d3-d700-4776-9e38-dd4e1d76ec7a tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:10:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c94757d3-d700-4776-9e38-dd4e1d76ec7a tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:10:02 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c94757d3-d700-4776-9e38-dd4e1d76ec7a tempest-GroupSnapshotsTest-1636033596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:10:02 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c94757d3-d700-4776-9e38-dd4e1d76ec7a tempest-GroupSnapshotsTest-1636033596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:10:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c94757d3-d700-4776-9e38-dd4e1d76ec7a tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:10:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c94757d3-d700-4776-9e38-dd4e1d76ec7a tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:02 devstack sudo[92150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:10:02 devstack sudo[92150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:02 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b46d9412-a954-4adb-a058-e6ade9a6bfbc tempest-VolumeQuotasNegativeTestJSON-449062712 None] Acquiring lock "cinder-0b4aa6b2-5ae6-4dc6-a6d8-05f9ccc77db7-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:10:02 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b46d9412-a954-4adb-a058-e6ade9a6bfbc tempest-VolumeQuotasNegativeTestJSON-449062712 None] Lock "cinder-0b4aa6b2-5ae6-4dc6-a6d8-05f9ccc77db7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:10:02 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b46d9412-a954-4adb-a058-e6ade9a6bfbc tempest-VolumeQuotasNegativeTestJSON-449062712 None] Acquiring lock "cinder-quobyte-0b4aa6b2-5ae6-4dc6-a6d8-05f9ccc77db7" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:10:02 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d6e53741-7f3e-45a5-9980-afc79efd731b tempest-ServersNegativeTestJSON-1782234973 None] Acquiring lock "cinder-2d786e16-e070-4f9d-a96b-f560bb315a32-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:10:02 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b46d9412-a954-4adb-a058-e6ade9a6bfbc tempest-VolumeQuotasNegativeTestJSON-449062712 None] Lock "cinder-quobyte-0b4aa6b2-5ae6-4dc6-a6d8-05f9ccc77db7" acquired by "delete_volume" :: waited 0.026s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:10:02 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d6e53741-7f3e-45a5-9980-afc79efd731b tempest-ServersNegativeTestJSON-1782234973 None] Lock "cinder-2d786e16-e070-4f9d-a96b-f560bb315a32-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:10:02 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1720e4-776d-48ff-a8e4-f7c48b9c6670]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:10:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b46d9412-a954-4adb-a058-e6ade9a6bfbc tempest-VolumeQuotasNegativeTestJSON-449062712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0b4aa6b2-5ae6-4dc6-a6d8-05f9ccc77db7 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:02 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d6e53741-7f3e-45a5-9980-afc79efd731b tempest-ServersNegativeTestJSON-1782234973 None] Acquiring lock "cinder-quobyte-2d786e16-e070-4f9d-a96b-f560bb315a32" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:10:02 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d6e53741-7f3e-45a5-9980-afc79efd731b tempest-ServersNegativeTestJSON-1782234973 None] Lock "cinder-quobyte-2d786e16-e070-4f9d-a96b-f560bb315a32" acquired by "delete_volume" :: waited 0.017s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:10:02 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a38ea8b-923e-4698-9eac-23cffa7ec7c1]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:10:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d6e53741-7f3e-45a5-9980-afc79efd731b tempest-ServersNegativeTestJSON-1782234973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2d786e16-e070-4f9d-a96b-f560bb315a32 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:02 devstack sudo[92150]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c94757d3-d700-4776-9e38-dd4e1d76ec7a tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.308s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:02 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-c94757d3-d700-4776-9e38-dd4e1d76ec7a tempest-GroupSnapshotsTest-1636033596 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:10:02 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-c94757d3-d700-4776-9e38-dd4e1d76ec7a tempest-GroupSnapshotsTest-1636033596 None] Delete group completed successfully. Jul 21 02:10:02 devstack sudo[92152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0b4aa6b2-5ae6-4dc6-a6d8-05f9ccc77db7 Jul 21 02:10:02 devstack sudo[92152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:02 devstack sudo[92154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2d786e16-e070-4f9d-a96b-f560bb315a32 Jul 21 02:10:02 devstack sudo[92154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:02 devstack sudo[92152]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b46d9412-a954-4adb-a058-e6ade9a6bfbc tempest-VolumeQuotasNegativeTestJSON-449062712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0b4aa6b2-5ae6-4dc6-a6d8-05f9ccc77db7" returned: 0 in 0.488s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b46d9412-a954-4adb-a058-e6ade9a6bfbc tempest-VolumeQuotasNegativeTestJSON-449062712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0b4aa6b2-5ae6-4dc6-a6d8-05f9ccc77db7 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:02 devstack sudo[92154]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:02 devstack sudo[92163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0b4aa6b2-5ae6-4dc6-a6d8-05f9ccc77db7 Jul 21 02:10:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d6e53741-7f3e-45a5-9980-afc79efd731b tempest-ServersNegativeTestJSON-1782234973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2d786e16-e070-4f9d-a96b-f560bb315a32" returned: 0 in 0.438s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d6e53741-7f3e-45a5-9980-afc79efd731b tempest-ServersNegativeTestJSON-1782234973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2d786e16-e070-4f9d-a96b-f560bb315a32 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:02 devstack sudo[92163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:02 devstack sudo[92165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2d786e16-e070-4f9d-a96b-f560bb315a32 Jul 21 02:10:02 devstack sudo[92165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:02 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-d043d76a-c5e8-4cc2-9c81-8cce5b39ced1 tempest-GroupSnapshotsTest-1636033596 None] Group tempest-GroupSnapshotsTest-Group-1566052535: creating Jul 21 02:10:03 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-d043d76a-c5e8-4cc2-9c81-8cce5b39ced1 tempest-GroupSnapshotsTest-1636033596 None] Group tempest-GroupSnapshotsTest-Group-1566052535: created successfully Jul 21 02:10:03 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-d043d76a-c5e8-4cc2-9c81-8cce5b39ced1 tempest-GroupSnapshotsTest-1636033596 None] Create group completed successfully. Jul 21 02:10:03 devstack sudo[92163]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b46d9412-a954-4adb-a058-e6ade9a6bfbc tempest-VolumeQuotasNegativeTestJSON-449062712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0b4aa6b2-5ae6-4dc6-a6d8-05f9ccc77db7" returned: 0 in 0.285s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:03 devstack sudo[92165]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d6e53741-7f3e-45a5-9980-afc79efd731b tempest-ServersNegativeTestJSON-1782234973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2d786e16-e070-4f9d-a96b-f560bb315a32" returned: 0 in 0.260s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b46d9412-a954-4adb-a058-e6ade9a6bfbc tempest-VolumeQuotasNegativeTestJSON-449062712 None] Lock "cinder-quobyte-0b4aa6b2-5ae6-4dc6-a6d8-05f9ccc77db7" released by "delete_volume" :: held 0.837s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:10:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d6e53741-7f3e-45a5-9980-afc79efd731b tempest-ServersNegativeTestJSON-1782234973 None] Lock "cinder-quobyte-2d786e16-e070-4f9d-a96b-f560bb315a32" released by "delete_volume" :: held 0.748s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:10:03 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-b46d9412-a954-4adb-a058-e6ade9a6bfbc tempest-VolumeQuotasNegativeTestJSON-449062712 None] Created reservations ['2fba2bc6-2cd5-4fe1-a482-acc752070307', '4841f37d-eead-497d-932d-0f0b36a7b76c', '1bc12c45-bb82-449f-b1a0-05cda93c39a2', '8cee2389-9d35-4f53-a1ad-2ae79c54e0a1'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:10:03 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-d6e53741-7f3e-45a5-9980-afc79efd731b tempest-ServersNegativeTestJSON-1782234973 None] Created reservations ['59b3ee0a-c340-4053-89e7-f1e5db9b953b', 'd70ecfe6-dfed-4390-9db2-2e153c49d9ee', 'adf86a9a-b4cd-446f-8d2c-a1c30c36d5c5', 'b32c1a9b-e1f9-4460-8739-b12a5309acea'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:10:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b46d9412-a954-4adb-a058-e6ade9a6bfbc tempest-VolumeQuotasNegativeTestJSON-449062712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:10:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b46d9412-a954-4adb-a058-e6ade9a6bfbc tempest-VolumeQuotasNegativeTestJSON-449062712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:10:03 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b46d9412-a954-4adb-a058-e6ade9a6bfbc tempest-VolumeQuotasNegativeTestJSON-449062712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:10:03 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b46d9412-a954-4adb-a058-e6ade9a6bfbc tempest-VolumeQuotasNegativeTestJSON-449062712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:10:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b46d9412-a954-4adb-a058-e6ade9a6bfbc tempest-VolumeQuotasNegativeTestJSON-449062712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:10:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b46d9412-a954-4adb-a058-e6ade9a6bfbc tempest-VolumeQuotasNegativeTestJSON-449062712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:03 devstack sudo[92169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:10:03 devstack sudo[92169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d6e53741-7f3e-45a5-9980-afc79efd731b tempest-ServersNegativeTestJSON-1782234973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:10:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d6e53741-7f3e-45a5-9980-afc79efd731b tempest-ServersNegativeTestJSON-1782234973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:10:03 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d6e53741-7f3e-45a5-9980-afc79efd731b tempest-ServersNegativeTestJSON-1782234973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:10:03 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d6e53741-7f3e-45a5-9980-afc79efd731b tempest-ServersNegativeTestJSON-1782234973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:10:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d6e53741-7f3e-45a5-9980-afc79efd731b tempest-ServersNegativeTestJSON-1782234973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:10:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d6e53741-7f3e-45a5-9980-afc79efd731b tempest-ServersNegativeTestJSON-1782234973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:03 devstack sudo[92171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:10:03 devstack sudo[92171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a4aa267f-04b9-4288-8ae6-2be1e254cf1e tempest-ServersNegativeTestJSON-1782234973 None] Acquiring lock "cinder-5d862213-67e8-499d-833e-816a76720e52-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:10:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a4aa267f-04b9-4288-8ae6-2be1e254cf1e tempest-ServersNegativeTestJSON-1782234973 None] Lock "cinder-5d862213-67e8-499d-833e-816a76720e52-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:10:03 devstack sudo[92169]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b46d9412-a954-4adb-a058-e6ade9a6bfbc tempest-VolumeQuotasNegativeTestJSON-449062712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.417s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:03 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-b46d9412-a954-4adb-a058-e6ade9a6bfbc tempest-VolumeQuotasNegativeTestJSON-449062712 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:10:03 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-b46d9412-a954-4adb-a058-e6ade9a6bfbc tempest-VolumeQuotasNegativeTestJSON-449062712 None] Deleted volume successfully. Jul 21 02:10:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a4aa267f-04b9-4288-8ae6-2be1e254cf1e tempest-ServersNegativeTestJSON-1782234973 None] Acquiring lock "cinder-quobyte-5d862213-67e8-499d-833e-816a76720e52" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:10:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b46d9412-a954-4adb-a058-e6ade9a6bfbc tempest-VolumeQuotasNegativeTestJSON-449062712 None] Lock "cinder-0b4aa6b2-5ae6-4dc6-a6d8-05f9ccc77db7-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:10:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a4aa267f-04b9-4288-8ae6-2be1e254cf1e tempest-ServersNegativeTestJSON-1782234973 None] Lock "cinder-quobyte-5d862213-67e8-499d-833e-816a76720e52" acquired by "delete_volume" :: waited 0.019s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:10:03 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[598fde71-3ed4-4a2d-82e5-02e9a1e04fc1]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:10:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a4aa267f-04b9-4288-8ae6-2be1e254cf1e tempest-ServersNegativeTestJSON-1782234973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5d862213-67e8-499d-833e-816a76720e52 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:03 devstack sudo[92171]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d6e53741-7f3e-45a5-9980-afc79efd731b tempest-ServersNegativeTestJSON-1782234973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.484s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:03 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-d6e53741-7f3e-45a5-9980-afc79efd731b tempest-ServersNegativeTestJSON-1782234973 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:10:03 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-d6e53741-7f3e-45a5-9980-afc79efd731b tempest-ServersNegativeTestJSON-1782234973 None] Deleted volume successfully. Jul 21 02:10:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d6e53741-7f3e-45a5-9980-afc79efd731b tempest-ServersNegativeTestJSON-1782234973 None] Lock "cinder-2d786e16-e070-4f9d-a96b-f560bb315a32-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:10:03 devstack sudo[92181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5d862213-67e8-499d-833e-816a76720e52 Jul 21 02:10:03 devstack sudo[92181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:04 devstack sudo[92181]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a4aa267f-04b9-4288-8ae6-2be1e254cf1e tempest-ServersNegativeTestJSON-1782234973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5d862213-67e8-499d-833e-816a76720e52" returned: 0 in 0.512s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a4aa267f-04b9-4288-8ae6-2be1e254cf1e tempest-ServersNegativeTestJSON-1782234973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5d862213-67e8-499d-833e-816a76720e52 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:04 devstack sudo[92187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5d862213-67e8-499d-833e-816a76720e52 Jul 21 02:10:04 devstack sudo[92187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:04 devstack sudo[92187]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a4aa267f-04b9-4288-8ae6-2be1e254cf1e tempest-ServersNegativeTestJSON-1782234973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5d862213-67e8-499d-833e-816a76720e52" returned: 0 in 0.339s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:04 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a4aa267f-04b9-4288-8ae6-2be1e254cf1e tempest-ServersNegativeTestJSON-1782234973 None] Lock "cinder-quobyte-5d862213-67e8-499d-833e-816a76720e52" released by "delete_volume" :: held 0.930s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:10:04 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-a4aa267f-04b9-4288-8ae6-2be1e254cf1e tempest-ServersNegativeTestJSON-1782234973 None] Created reservations ['812f8c10-d4bb-45d6-ab28-faf69f154fe2', 'fe2236d2-01de-47a3-9727-fafe347b4b18', '39558539-403c-48dd-893c-b9a6f475474f', '9edede5d-70d8-4c58-8dde-62b21f39e774'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:10:04 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:10:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] Flow 'volume_create_manager' (4dfe89fd-302a-4c7d-9874-aadd5e69fae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:10:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89bef9ec-158c-41b2-8d07-5658a99aaac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:10:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89bef9ec-158c-41b2-8d07-5658a99aaac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-555343281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=37d27d57-da31-4f79-be39-7edf38687b83,host='devstack@QuobyteHD#QuobyteHD',id=c3828246-8044-4a77-bcd1-4e39ef755e8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284ae0621ccc49438147ad22d0766a68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:10:05Z,use_quota=True,user_id='89ff5de8c8bc4e9f886a366cf52aed8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4bddd34-03a3-4896-8918-f8af8a03d4dd),volume_type_id=e4bddd34-03a3-4896-8918-f8af8a03d4dd)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b90cf679-43b2-4657-97dc-c8dfc17f1193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:10:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b90cf679-43b2-4657-97dc-c8dfc17f1193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c63663-d412-4b92-b107-7f5b9a4974c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:10:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c63663-d412-4b92-b107-7f5b9a4974c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3828246-8044-4a77-bcd1-4e39ef755e8c', 'volume_name': 'volume-c3828246-8044-4a77-bcd1-4e39ef755e8c', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df9f634d-b62c-466f-add0-cca468eddba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:10:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df9f634d-b62c-466f-add0-cca468eddba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (187848b0-cd90-4c15-9345-268d56baa90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:10:05 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] Volume c3828246-8044-4a77-bcd1-4e39ef755e8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3828246-8044-4a77-bcd1-4e39ef755e8c', 'volume_size': 1} Jul 21 02:10:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:10:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:10:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=37d27d57-da31-4f79-be39-7edf38687b83,created_at=2026-07-21T00:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-555343281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=37d27d57-da31-4f79-be39-7edf38687b83,host='devstack@QuobyteHD#QuobyteHD',id=c3828246-8044-4a77-bcd1-4e39ef755e8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284ae0621ccc49438147ad22d0766a68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:10:05Z,use_quota=True,user_id='89ff5de8c8bc4e9f886a366cf52aed8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4bddd34-03a3-4896-8918-f8af8a03d4dd),volume_type_id=e4bddd34-03a3-4896-8918-f8af8a03d4dd)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:10:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] Creating volume c3828246-8044-4a77-bcd1-4e39ef755e8c {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:10:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:10:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:10:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:10:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:10:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:10:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:10:05 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:10:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:05 devstack sudo[92190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c 1073741824 Jul 21 02:10:05 devstack sudo[92190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a4aa267f-04b9-4288-8ae6-2be1e254cf1e tempest-ServersNegativeTestJSON-1782234973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:10:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a4aa267f-04b9-4288-8ae6-2be1e254cf1e tempest-ServersNegativeTestJSON-1782234973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:10:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-a4aa267f-04b9-4288-8ae6-2be1e254cf1e tempest-ServersNegativeTestJSON-1782234973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:10:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-a4aa267f-04b9-4288-8ae6-2be1e254cf1e tempest-ServersNegativeTestJSON-1782234973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:10:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a4aa267f-04b9-4288-8ae6-2be1e254cf1e tempest-ServersNegativeTestJSON-1782234973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:10:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a4aa267f-04b9-4288-8ae6-2be1e254cf1e tempest-ServersNegativeTestJSON-1782234973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:05 devstack sudo[92192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:10:05 devstack sudo[92192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:05 devstack sudo[92192]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a4aa267f-04b9-4288-8ae6-2be1e254cf1e tempest-ServersNegativeTestJSON-1782234973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.315s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:05 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-a4aa267f-04b9-4288-8ae6-2be1e254cf1e tempest-ServersNegativeTestJSON-1782234973 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:10:05 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-a4aa267f-04b9-4288-8ae6-2be1e254cf1e tempest-ServersNegativeTestJSON-1782234973 None] Deleted volume successfully. Jul 21 02:10:05 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a4aa267f-04b9-4288-8ae6-2be1e254cf1e tempest-ServersNegativeTestJSON-1782234973 None] Lock "cinder-5d862213-67e8-499d-833e-816a76720e52-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:10:05 devstack sudo[92190]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c 1073741824" returned: 0 in 0.547s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:05 devstack sudo[92199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c Jul 21 02:10:05 devstack sudo[92199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:05 devstack sudo[92199]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c" returned: 0 in 0.349s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:10:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:10:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (187848b0-cd90-4c15-9345-268d56baa90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3828246-8044-4a77-bcd1-4e39ef755e8c', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59151179-a816-4a0d-bccf-fec51fb2fa8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:10:06 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] Volume volume-c3828246-8044-4a77-bcd1-4e39ef755e8c (c3828246-8044-4a77-bcd1-4e39ef755e8c): created successfully Jul 21 02:10:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59151179-a816-4a0d-bccf-fec51fb2fa8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] Flow 'volume_create_manager' (4dfe89fd-302a-4c7d-9874-aadd5e69fae4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:10:06 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-5b28511b-66c6-47ad-8038-4ba4a3291b36 tempest-GroupSnapshotsTest-1636033596 None] Created volume successfully. Jul 21 02:10:08 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:10:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] Flow 'volume_create_manager' (304df51e-04fc-4a32-9dae-155bb930424c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:10:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daaee9ea-6671-4f5f-8819-59cc90aca188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:10:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daaee9ea-6671-4f5f-8819-59cc90aca188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-44762844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=37d27d57-da31-4f79-be39-7edf38687b83,host='devstack@QuobyteHD#QuobyteHD',id=235d5c40-621f-4dcd-b10f-c7f6578aa858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284ae0621ccc49438147ad22d0766a68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:10:08Z,use_quota=True,user_id='89ff5de8c8bc4e9f886a366cf52aed8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4bddd34-03a3-4896-8918-f8af8a03d4dd),volume_type_id=e4bddd34-03a3-4896-8918-f8af8a03d4dd)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a37d410f-80af-473e-9286-48d3a8a6d167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:10:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a37d410f-80af-473e-9286-48d3a8a6d167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a35b7a16-54c2-46c8-ba17-93e7d58fc0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:10:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a35b7a16-54c2-46c8-ba17-93e7d58fc0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '235d5c40-621f-4dcd-b10f-c7f6578aa858', 'volume_name': 'volume-235d5c40-621f-4dcd-b10f-c7f6578aa858', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbed07bb-13c3-4c7a-b16f-eb26db26dd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:10:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbed07bb-13c3-4c7a-b16f-eb26db26dd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b67c6112-2254-495b-aa1f-ce805e0d0a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:10:08 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] Volume 235d5c40-621f-4dcd-b10f-c7f6578aa858: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-235d5c40-621f-4dcd-b10f-c7f6578aa858', 'volume_size': 1} Jul 21 02:10:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:10:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:10:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=37d27d57-da31-4f79-be39-7edf38687b83,created_at=2026-07-21T00:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-44762844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=37d27d57-da31-4f79-be39-7edf38687b83,host='devstack@QuobyteHD#QuobyteHD',id=235d5c40-621f-4dcd-b10f-c7f6578aa858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284ae0621ccc49438147ad22d0766a68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:10:08Z,use_quota=True,user_id='89ff5de8c8bc4e9f886a366cf52aed8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4bddd34-03a3-4896-8918-f8af8a03d4dd),volume_type_id=e4bddd34-03a3-4896-8918-f8af8a03d4dd)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:10:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] Creating volume 235d5c40-621f-4dcd-b10f-c7f6578aa858 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:10:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:10:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:10:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:10:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:10:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:10:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:10:08 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:10:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:08 devstack sudo[92236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858 1073741824 Jul 21 02:10:08 devstack sudo[92236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:08 devstack sudo[92236]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858 1073741824" returned: 0 in 0.552s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:08 devstack sudo[92245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858 Jul 21 02:10:09 devstack sudo[92245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:09 devstack sudo[92245]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858" returned: 0 in 0.325s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:09 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:10:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:10:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b67c6112-2254-495b-aa1f-ce805e0d0a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-235d5c40-621f-4dcd-b10f-c7f6578aa858', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64bacdfd-6eea-42e7-9baa-0427b7d753e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:10:09 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] Volume volume-235d5c40-621f-4dcd-b10f-c7f6578aa858 (235d5c40-621f-4dcd-b10f-c7f6578aa858): created successfully Jul 21 02:10:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64bacdfd-6eea-42e7-9baa-0427b7d753e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] Flow 'volume_create_manager' (304df51e-04fc-4a32-9dae-155bb930424c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:10:09 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-ec1be93a-a79b-4531-a79d-16a09ec96e40 tempest-GroupSnapshotsTest-1636033596 None] Created volume successfully. Jul 21 02:10:10 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-ae9a2428-732f-4dff-a661-0f1ee659f9f1 tempest-GroupSnapshotsTest-1636033596 None] Update group completed successfully. Jul 21 02:10:12 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-a08e2194-7e8d-40d7-8aa0-f991a4a40ec6 tempest-GroupSnapshotsTest-1636033596 None] Update group completed successfully. Jul 21 02:10:12 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:10:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] Flow 'volume_create_manager' (b25c144d-2265-411b-bb57-9bf329c931a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:10:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9478c95-3656-4c42-81fa-d4eaef959c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:10:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9478c95-3656-4c42-81fa-d4eaef959c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1320956078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdd2dfa4-bf9a-43eb-ae87-e7364115df2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba729fa0b6c945f49f04b77146c16afe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:10:13Z,use_quota=True,user_id='5810e1e223f94d54a0662920d7f4d463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8963674-740a-49c6-ac80-1f65a71b8386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:10:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8963674-740a-49c6-ac80-1f65a71b8386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af9cdac7-5cc7-4068-a272-907cb0b7d4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:10:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af9cdac7-5cc7-4068-a272-907cb0b7d4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdd2dfa4-bf9a-43eb-ae87-e7364115df2f', 'volume_name': 'volume-fdd2dfa4-bf9a-43eb-ae87-e7364115df2f', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d23cb876-401b-48a2-945a-638ccfeabdd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:10:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d23cb876-401b-48a2-945a-638ccfeabdd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17f85cb-1e66-489e-9285-04f3d84e07eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:10:12 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] Volume fdd2dfa4-bf9a-43eb-ae87-e7364115df2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdd2dfa4-bf9a-43eb-ae87-e7364115df2f', 'volume_size': 1} Jul 21 02:10:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:10:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:10:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1320956078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdd2dfa4-bf9a-43eb-ae87-e7364115df2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba729fa0b6c945f49f04b77146c16afe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:10:13Z,use_quota=True,user_id='5810e1e223f94d54a0662920d7f4d463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:10:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] Creating volume fdd2dfa4-bf9a-43eb-ae87-e7364115df2f {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:10:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:10:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:10:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:10:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:10:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:10:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:10:12 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:10:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fdd2dfa4-bf9a-43eb-ae87-e7364115df2f 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:12 devstack sudo[92252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fdd2dfa4-bf9a-43eb-ae87-e7364115df2f 1073741824 Jul 21 02:10:12 devstack sudo[92252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:13 devstack sudo[92252]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fdd2dfa4-bf9a-43eb-ae87-e7364115df2f 1073741824" returned: 0 in 0.549s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fdd2dfa4-bf9a-43eb-ae87-e7364115df2f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:13 devstack sudo[92259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fdd2dfa4-bf9a-43eb-ae87-e7364115df2f Jul 21 02:10:13 devstack sudo[92259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:13 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-14b89f30-be74-4c5c-83c5-cf0fd2d61eaa tempest-GroupSnapshotsTest-1636033596 None] Update group completed successfully. Jul 21 02:10:13 devstack sudo[92259]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fdd2dfa4-bf9a-43eb-ae87-e7364115df2f" returned: 0 in 0.278s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:10:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:10:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17f85cb-1e66-489e-9285-04f3d84e07eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdd2dfa4-bf9a-43eb-ae87-e7364115df2f', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e404725e-4986-4902-afb1-8a86c56e1a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:10:13 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] Volume volume-fdd2dfa4-bf9a-43eb-ae87-e7364115df2f (fdd2dfa4-bf9a-43eb-ae87-e7364115df2f): created successfully Jul 21 02:10:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e404725e-4986-4902-afb1-8a86c56e1a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] Flow 'volume_create_manager' (b25c144d-2265-411b-bb57-9bf329c931a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:10:13 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-cea26fc1-c819-4794-af22-967638cf68d7 tempest-AttachVolumeNegativeTest-1066125899 None] Created volume successfully. Jul 21 02:10:14 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-762bc6f6-0fb2-4f77-8489-59f83689e7cb tempest-GroupSnapshotsTest-1636033596 None] Update group completed successfully. Jul 21 02:10:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-6b70e633-ffa0-476e-b43d-89c47d6d68c6 req-864fc19f-ad76-47ff-bc38-08168f116004 tempest-AttachVolumeNegativeTest-1066125899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:10:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-6b70e633-ffa0-476e-b43d-89c47d6d68c6 req-864fc19f-ad76-47ff-bc38-08168f116004 tempest-AttachVolumeNegativeTest-1066125899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:10:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-6b70e633-ffa0-476e-b43d-89c47d6d68c6 req-864fc19f-ad76-47ff-bc38-08168f116004 tempest-AttachVolumeNegativeTest-1066125899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:10:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-6b70e633-ffa0-476e-b43d-89c47d6d68c6 req-864fc19f-ad76-47ff-bc38-08168f116004 tempest-AttachVolumeNegativeTest-1066125899 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea', 'name': 'volume-fdd2dfa4-bf9a-43eb-ae87-e7364115df2f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5412419a-ffe6-4d0e-90cd-d6aa4a261744', 'enforce_multipath': True} {{(pid=87566) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 02:10:15 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-6b70e633-ffa0-476e-b43d-89c47d6d68c6 req-864fc19f-ad76-47ff-bc38-08168f116004 tempest-AttachVolumeNegativeTest-1066125899 None] attachment_update completed successfully. Jul 21 02:10:16 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] GroupSnapshot 0e4271c1-4716-45ae-9c4b-5f1f5db5a7e0: creating. Jul 21 02:10:16 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] Group snapshot 0e4271c1-4716-45ae-9c4b-5f1f5db5a7e0: creating. {{(pid=87566) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 21 02:10:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:10:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:10:16 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] Creating offline snapshot 7b0cd77b-7c94-4640-a603-042c03af9e3f of volume c3828246-8044-4a77-bcd1-4e39ef755e8c {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:10:16 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[3494eb03-4732-4088-b8f5-8e8f6564ddce]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:10:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:16 devstack sudo[92658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c Jul 21 02:10:16 devstack sudo[92658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:17 devstack sudo[92658]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c" returned: 0 in 0.557s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c.7b0cd77b-7c94-4640-a603-042c03af9e3f 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:17 devstack sudo[92663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c.7b0cd77b-7c94-4640-a603-042c03af9e3f 1G Jul 21 02:10:17 devstack sudo[92663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:17 devstack sudo[92663]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c.7b0cd77b-7c94-4640-a603-042c03af9e3f 1G" returned: 0 in 0.532s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3828246-8044-4a77-bcd1-4e39ef755e8c -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c.7b0cd77b-7c94-4640-a603-042c03af9e3f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:17 devstack sudo[92671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3828246-8044-4a77-bcd1-4e39ef755e8c -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c.7b0cd77b-7c94-4640-a603-042c03af9e3f Jul 21 02:10:17 devstack sudo[92671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:18 devstack sudo[92671]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3828246-8044-4a77-bcd1-4e39ef755e8c -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c.7b0cd77b-7c94-4640-a603-042c03af9e3f" returned: 0 in 0.408s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:18 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c.7b0cd77b-7c94-4640-a603-042c03af9e3f is being set with open permissions: ugo+rw: NotImplementedError Jul 21 02:10:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c.7b0cd77b-7c94-4640-a603-042c03af9e3f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:18 devstack sudo[92676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c.7b0cd77b-7c94-4640-a603-042c03af9e3f Jul 21 02:10:18 devstack sudo[92676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:18 devstack sudo[92676]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c.7b0cd77b-7c94-4640-a603-042c03af9e3f" returned: 0 in 0.315s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:18 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:UPDATE=116,cinder:SELECT=96,cinder:INSERT=31,cinder:DELETE=8 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:10:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:18 devstack sudo[92679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c.info Jul 21 02:10:18 devstack sudo[92679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:18 devstack sudo[92679]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c.info" returned: 0 in 0.335s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:18 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 02:10:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:18 devstack sudo[92682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c.info Jul 21 02:10:18 devstack sudo[92682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:19 devstack sudo[92682]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c.info" returned: 0 in 0.269s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.531s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:10:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:10:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:10:19 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] Creating offline snapshot 85a9592a-22c8-4809-b721-613cb70492dc of volume 235d5c40-621f-4dcd-b10f-c7f6578aa858 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:10:19 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9af309-1f02-4b91-a1fd-e086d02b27a2]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:10:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:19 devstack sudo[92685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858 Jul 21 02:10:19 devstack sudo[92685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:19 devstack sudo[92685]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858" returned: 0 in 0.419s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858.85a9592a-22c8-4809-b721-613cb70492dc 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:19 devstack sudo[92690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858.85a9592a-22c8-4809-b721-613cb70492dc 1G Jul 21 02:10:19 devstack sudo[92690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:20 devstack sudo[92690]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858.85a9592a-22c8-4809-b721-613cb70492dc 1G" returned: 0 in 0.527s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-235d5c40-621f-4dcd-b10f-c7f6578aa858 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858.85a9592a-22c8-4809-b721-613cb70492dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:20 devstack sudo[92696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-235d5c40-621f-4dcd-b10f-c7f6578aa858 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858.85a9592a-22c8-4809-b721-613cb70492dc Jul 21 02:10:20 devstack sudo[92696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:20 devstack sudo[92696]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-235d5c40-621f-4dcd-b10f-c7f6578aa858 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858.85a9592a-22c8-4809-b721-613cb70492dc" returned: 0 in 0.331s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:20 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858.85a9592a-22c8-4809-b721-613cb70492dc is being set with open permissions: ugo+rw: NotImplementedError Jul 21 02:10:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858.85a9592a-22c8-4809-b721-613cb70492dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:20 devstack sudo[92701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858.85a9592a-22c8-4809-b721-613cb70492dc Jul 21 02:10:20 devstack sudo[92701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:20 devstack sudo[92701]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858.85a9592a-22c8-4809-b721-613cb70492dc" returned: 0 in 0.287s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:20 devstack sudo[92704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858.info Jul 21 02:10:20 devstack sudo[92704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:21 devstack sudo[92704]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858.info" returned: 0 in 0.356s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:21 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 02:10:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:21 devstack sudo[92707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858.info Jul 21 02:10:21 devstack sudo[92707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:21 devstack sudo[92707]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858.info" returned: 0 in 0.290s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.325s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:10:21 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-a380f901-ddba-4786-a65f-a506bad191d5 tempest-GroupSnapshotsTest-1636033596 None] group_snapshot 0e4271c1-4716-45ae-9c4b-5f1f5db5a7e0: created successfully Jul 21 02:10:22 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] group_snapshot 0e4271c1-4716-45ae-9c4b-5f1f5db5a7e0: deleting Jul 21 02:10:22 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] group_snapshot 0e4271c1-4716-45ae-9c4b-5f1f5db5a7e0: deleting {{(pid=87566) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 21 02:10:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "cinder-quobyte-c3828246-8044-4a77-bcd1-4e39ef755e8c" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:10:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] Lock "cinder-quobyte-c3828246-8044-4a77-bcd1-4e39ef755e8c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:10:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "cinder-quobyte-7b0cd77b-7c94-4640-a603-042c03af9e3f" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:10:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] Lock "cinder-quobyte-7b0cd77b-7c94-4640-a603-042c03af9e3f" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:10:22 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] Deleting offline snapshot 7b0cd77b-7c94-4640-a603-042c03af9e3f of volume c3828246-8044-4a77-bcd1-4e39ef755e8c {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:10:22 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] snapshot_file for this snap is: volume-c3828246-8044-4a77-bcd1-4e39ef755e8c.7b0cd77b-7c94-4640-a603-042c03af9e3f {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:10:22 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a31ad0-5929-4335-a22b-b6c60e881b61]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:10:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c.7b0cd77b-7c94-4640-a603-042c03af9e3f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:22 devstack sudo[92711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c.7b0cd77b-7c94-4640-a603-042c03af9e3f Jul 21 02:10:22 devstack sudo[92711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:22 devstack sudo[92711]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c.7b0cd77b-7c94-4640-a603-042c03af9e3f" returned: 0 in 0.588s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:22 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3828246-8044-4a77-bcd1-4e39ef755e8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:10:22 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bd60c4-e3f7-4499-9a62-6bea9314156a]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:10:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:22 devstack sudo[92716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c Jul 21 02:10:22 devstack sudo[92716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:23 devstack sudo[92716]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c" returned: 0 in 0.444s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c.7b0cd77b-7c94-4640-a603-042c03af9e3f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:23 devstack sudo[92721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c.7b0cd77b-7c94-4640-a603-042c03af9e3f Jul 21 02:10:23 devstack sudo[92721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:23 devstack sudo[92721]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c.7b0cd77b-7c94-4640-a603-042c03af9e3f" returned: 0 in 0.569s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c.7b0cd77b-7c94-4640-a603-042c03af9e3f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:23 devstack sudo[92726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c.7b0cd77b-7c94-4640-a603-042c03af9e3f Jul 21 02:10:23 devstack sudo[92726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:24 devstack sudo[92726]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c.7b0cd77b-7c94-4640-a603-042c03af9e3f" returned: 0 in 0.347s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:24 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] Lock "cinder-quobyte-7b0cd77b-7c94-4640-a603-042c03af9e3f" released by "_delete_snapshot" :: held 2.101s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:10:24 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] Lock "cinder-quobyte-c3828246-8044-4a77-bcd1-4e39ef755e8c" released by "delete_snapshot" :: held 2.143s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:10:24 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "cinder-quobyte-235d5c40-621f-4dcd-b10f-c7f6578aa858" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:10:24 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] Lock "cinder-quobyte-235d5c40-621f-4dcd-b10f-c7f6578aa858" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:10:24 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "cinder-quobyte-85a9592a-22c8-4809-b721-613cb70492dc" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:10:24 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] Lock "cinder-quobyte-85a9592a-22c8-4809-b721-613cb70492dc" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:10:24 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] Deleting offline snapshot 85a9592a-22c8-4809-b721-613cb70492dc of volume 235d5c40-621f-4dcd-b10f-c7f6578aa858 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:10:24 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] snapshot_file for this snap is: volume-235d5c40-621f-4dcd-b10f-c7f6578aa858.85a9592a-22c8-4809-b721-613cb70492dc {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:10:24 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61d39ca-2835-47cb-b621-51f811104afb]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:10:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858.85a9592a-22c8-4809-b721-613cb70492dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:24 devstack sudo[92729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858.85a9592a-22c8-4809-b721-613cb70492dc Jul 21 02:10:24 devstack sudo[92729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:24 devstack sudo[92729]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858.85a9592a-22c8-4809-b721-613cb70492dc" returned: 0 in 0.589s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:24 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-235d5c40-621f-4dcd-b10f-c7f6578aa858(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:10:25 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c3200b-b576-4a28-8866-df9c11cdcc8f]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:10:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:25 devstack sudo[92734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858 Jul 21 02:10:25 devstack sudo[92734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:25 devstack sudo[92734]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858" returned: 0 in 0.481s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858.85a9592a-22c8-4809-b721-613cb70492dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:25 devstack sudo[92739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858.85a9592a-22c8-4809-b721-613cb70492dc Jul 21 02:10:25 devstack sudo[92739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:26 devstack sudo[92739]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858.85a9592a-22c8-4809-b721-613cb70492dc" returned: 0 in 0.543s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858.85a9592a-22c8-4809-b721-613cb70492dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:26 devstack sudo[92746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858.85a9592a-22c8-4809-b721-613cb70492dc Jul 21 02:10:26 devstack sudo[92746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:26 devstack sudo[92746]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858.85a9592a-22c8-4809-b721-613cb70492dc" returned: 0 in 0.321s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:26 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] Lock "cinder-quobyte-85a9592a-22c8-4809-b721-613cb70492dc" released by "_delete_snapshot" :: held 2.083s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:10:26 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] Lock "cinder-quobyte-235d5c40-621f-4dcd-b10f-c7f6578aa858" released by "delete_snapshot" :: held 2.110s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:10:26 devstack cinder-volume[87566]: WARNING cinder.quota [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-88087292 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-88087292, it is now deprecated. Please use the default quota class for default quota. Jul 21 02:10:26 devstack cinder-volume[87566]: WARNING cinder.quota [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-88087292 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-88087292, it is now deprecated. Please use the default quota class for default quota. Jul 21 02:10:26 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] Created reservations ['61e15083-d256-43ff-8428-d181764647f4', '53d1fcaf-9e9c-479f-ac4e-1035f0e9dcb8', '5ca1163a-ab9d-46c8-850d-3e006c986440', 'aca3a57c-516a-4f67-a32c-52123d53db4c'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:10:26 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] Created reservations ['79b0000e-7d63-495c-a2f5-0bc736bc267a', '1cd84bc1-cb89-48c5-bed2-a91509ca1987', '9a76f664-c355-4bf3-a18a-8ad2a6224bf4', 'd004c6d9-688d-449e-8fd3-980ae9370a8b'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:10:26 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-a0d0b23f-8770-4f2d-84eb-3d00e06a4227 tempest-GroupSnapshotsTest-1636033596 None] group_snapshot 0e4271c1-4716-45ae-9c4b-5f1f5db5a7e0: deleted successfully Jul 21 02:10:28 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-67890112-147e-4fe6-801b-fa86993bca2a tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "cinder-quobyte-235d5c40-621f-4dcd-b10f-c7f6578aa858" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:10:28 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-67890112-147e-4fe6-801b-fa86993bca2a tempest-GroupSnapshotsTest-1636033596 None] Lock "cinder-quobyte-235d5c40-621f-4dcd-b10f-c7f6578aa858" acquired by "delete_volume" :: waited 0.019s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:10:28 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbef3a70-2b9f-4393-837e-016b4a963494]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:10:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-67890112-147e-4fe6-801b-fa86993bca2a tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:28 devstack sudo[92750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858 Jul 21 02:10:28 devstack sudo[92750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:28 devstack sudo[92750]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-67890112-147e-4fe6-801b-fa86993bca2a tempest-GroupSnapshotsTest-1636033596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858" returned: 0 in 0.428s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-67890112-147e-4fe6-801b-fa86993bca2a tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:28 devstack sudo[92756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858 Jul 21 02:10:28 devstack sudo[92756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:29 devstack sudo[92756]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-67890112-147e-4fe6-801b-fa86993bca2a tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-235d5c40-621f-4dcd-b10f-c7f6578aa858" returned: 0 in 0.296s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:29 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-67890112-147e-4fe6-801b-fa86993bca2a tempest-GroupSnapshotsTest-1636033596 None] Lock "cinder-quobyte-235d5c40-621f-4dcd-b10f-c7f6578aa858" released by "delete_volume" :: held 0.804s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:10:29 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-67890112-147e-4fe6-801b-fa86993bca2a tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "cinder-quobyte-c3828246-8044-4a77-bcd1-4e39ef755e8c" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:10:29 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-67890112-147e-4fe6-801b-fa86993bca2a tempest-GroupSnapshotsTest-1636033596 None] Lock "cinder-quobyte-c3828246-8044-4a77-bcd1-4e39ef755e8c" acquired by "delete_volume" :: waited 0.016s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:10:29 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3b43b3-bfcc-49c3-ba4b-4f9f98d0a772]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:10:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-67890112-147e-4fe6-801b-fa86993bca2a tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:29 devstack sudo[92759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c Jul 21 02:10:29 devstack sudo[92759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:29 devstack sudo[92759]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-67890112-147e-4fe6-801b-fa86993bca2a tempest-GroupSnapshotsTest-1636033596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c" returned: 0 in 0.416s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-67890112-147e-4fe6-801b-fa86993bca2a tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:29 devstack sudo[92765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c Jul 21 02:10:29 devstack sudo[92765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:29 devstack sudo[92765]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-67890112-147e-4fe6-801b-fa86993bca2a tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c3828246-8044-4a77-bcd1-4e39ef755e8c" returned: 0 in 0.263s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:29 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-67890112-147e-4fe6-801b-fa86993bca2a tempest-GroupSnapshotsTest-1636033596 None] Lock "cinder-quobyte-c3828246-8044-4a77-bcd1-4e39ef755e8c" released by "delete_volume" :: held 0.757s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:10:29 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-67890112-147e-4fe6-801b-fa86993bca2a tempest-GroupSnapshotsTest-1636033596 None] Created reservations ['23935422-fcde-42fa-9231-0e4af399c93f'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:10:29 devstack cinder-volume[87566]: WARNING cinder.quota [None req-67890112-147e-4fe6-801b-fa86993bca2a tempest-GroupSnapshotsTest-1636033596 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-88087292 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-88087292, it is now deprecated. Please use the default quota class for default quota. Jul 21 02:10:29 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-67890112-147e-4fe6-801b-fa86993bca2a tempest-GroupSnapshotsTest-1636033596 None] Created reservations ['ce85f2d2-1c81-4e1b-a34f-a3f54d8dc270', '06e6317f-6377-4eeb-8720-1542ee0b183c', '025624d8-a341-4838-8cd4-b8f5601303db', '6dbfcfb0-c267-4830-97dc-0b182a3cef95'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:10:30 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-67890112-147e-4fe6-801b-fa86993bca2a tempest-GroupSnapshotsTest-1636033596 None] Created reservations ['b01492c8-6ce7-4fd4-ab38-842c24138b75', 'fb54b42e-8aec-4ced-9664-d3445c755bcf', '51ba88c5-4b93-4b6f-848b-9fde81511480', '7072b574-fc7e-44fc-a418-e1e68552d22f'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:10:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-67890112-147e-4fe6-801b-fa86993bca2a tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:10:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-67890112-147e-4fe6-801b-fa86993bca2a tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:10:30 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-67890112-147e-4fe6-801b-fa86993bca2a tempest-GroupSnapshotsTest-1636033596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:10:30 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-67890112-147e-4fe6-801b-fa86993bca2a tempest-GroupSnapshotsTest-1636033596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:10:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-67890112-147e-4fe6-801b-fa86993bca2a tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:10:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-67890112-147e-4fe6-801b-fa86993bca2a tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:30 devstack sudo[92768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:10:30 devstack sudo[92768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:30 devstack sudo[92768]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-67890112-147e-4fe6-801b-fa86993bca2a tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.282s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:30 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-67890112-147e-4fe6-801b-fa86993bca2a tempest-GroupSnapshotsTest-1636033596 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:10:30 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-67890112-147e-4fe6-801b-fa86993bca2a tempest-GroupSnapshotsTest-1636033596 None] Delete group completed successfully. Jul 21 02:10:31 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-307225bf-8120-4af8-8631-c9b44478d561 tempest-GroupSnapshotsTest-1636033596 None] Group tempest-GroupSnapshotsTest-Group-181436276: creating Jul 21 02:10:31 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-307225bf-8120-4af8-8631-c9b44478d561 tempest-GroupSnapshotsTest-1636033596 None] Group tempest-GroupSnapshotsTest-Group-181436276: created successfully Jul 21 02:10:31 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-307225bf-8120-4af8-8631-c9b44478d561 tempest-GroupSnapshotsTest-1636033596 None] Create group completed successfully. Jul 21 02:10:33 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:10:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] Flow 'volume_create_manager' (dfa8de49-1c2d-4978-8650-4a7516966fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:10:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b23f01c-10e1-427f-bfbe-36e250e14c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:10:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b23f01c-10e1-427f-bfbe-36e250e14c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-626362794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d9e05f29-c351-44bd-bb32-dd0b26837893,host='devstack@QuobyteHD#QuobyteHD',id=5b80f2e9-f3be-4fd5-a226-e94c0a31ef81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284ae0621ccc49438147ad22d0766a68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:10:33Z,use_quota=True,user_id='89ff5de8c8bc4e9f886a366cf52aed8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(feb5edcc-46ad-402f-b649-e0c3ab184b05),volume_type_id=feb5edcc-46ad-402f-b649-e0c3ab184b05)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0694d245-7f3c-4725-a39e-60c8bc00c974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:10:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0694d245-7f3c-4725-a39e-60c8bc00c974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4aa3e19-48c1-4169-818f-07bbea2553a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:10:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4aa3e19-48c1-4169-818f-07bbea2553a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b80f2e9-f3be-4fd5-a226-e94c0a31ef81', 'volume_name': 'volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f161a240-863f-40ab-b9b9-6aeca86f9bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:10:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f161a240-863f-40ab-b9b9-6aeca86f9bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4127c4-22cd-423d-9ce2-b11deeb4bd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:10:33 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] Volume 5b80f2e9-f3be-4fd5-a226-e94c0a31ef81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81', 'volume_size': 1} Jul 21 02:10:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:10:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:10:33 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d9e05f29-c351-44bd-bb32-dd0b26837893,created_at=2026-07-21T00:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-626362794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d9e05f29-c351-44bd-bb32-dd0b26837893,host='devstack@QuobyteHD#QuobyteHD',id=5b80f2e9-f3be-4fd5-a226-e94c0a31ef81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284ae0621ccc49438147ad22d0766a68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:10:33Z,use_quota=True,user_id='89ff5de8c8bc4e9f886a366cf52aed8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(feb5edcc-46ad-402f-b649-e0c3ab184b05),volume_type_id=feb5edcc-46ad-402f-b649-e0c3ab184b05)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:10:33 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] Creating volume 5b80f2e9-f3be-4fd5-a226-e94c0a31ef81 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:10:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:10:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:10:33 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:10:33 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:10:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:10:33 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:10:33 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:10:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:33 devstack sudo[92790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81 1073741824 Jul 21 02:10:33 devstack sudo[92790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:34 devstack sudo[92790]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81 1073741824" returned: 0 in 0.815s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:34 devstack sudo[92810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81 Jul 21 02:10:34 devstack sudo[92810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:34 devstack sudo[92810]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81" returned: 0 in 0.408s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:10:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:10:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4127c4-22cd-423d-9ce2-b11deeb4bd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53354bae-44b3-4c9a-8a45-92c87a2a2724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:10:34 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] Volume volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81 (5b80f2e9-f3be-4fd5-a226-e94c0a31ef81): created successfully Jul 21 02:10:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53354bae-44b3-4c9a-8a45-92c87a2a2724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] Flow 'volume_create_manager' (dfa8de49-1c2d-4978-8650-4a7516966fe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:10:34 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-27b6d9f6-2dc6-4ff3-8c1e-35df7b0d1449 tempest-GroupSnapshotsTest-1636033596 None] Created volume successfully. Jul 21 02:10:36 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-fb280cef-f587-415a-a254-3b617764c566 tempest-GroupSnapshotsTest-1636033596 None] GroupSnapshot 38e08403-7ec0-483d-a30e-c6d2e1233ef4: creating. Jul 21 02:10:36 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-fb280cef-f587-415a-a254-3b617764c566 tempest-GroupSnapshotsTest-1636033596 None] Group snapshot 38e08403-7ec0-483d-a30e-c6d2e1233ef4: creating. {{(pid=87566) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 21 02:10:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-fb280cef-f587-415a-a254-3b617764c566 tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:10:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-fb280cef-f587-415a-a254-3b617764c566 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:10:36 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-fb280cef-f587-415a-a254-3b617764c566 tempest-GroupSnapshotsTest-1636033596 None] Creating offline snapshot 8314a59c-9974-4354-bc4a-c93614666502 of volume 5b80f2e9-f3be-4fd5-a226-e94c0a31ef81 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:10:36 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[08aaa179-59d3-4195-a850-4c950bfe3f83]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:10:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fb280cef-f587-415a-a254-3b617764c566 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:36 devstack sudo[92848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81 Jul 21 02:10:36 devstack sudo[92848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:36 devstack sudo[92848]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fb280cef-f587-415a-a254-3b617764c566 tempest-GroupSnapshotsTest-1636033596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81" returned: 0 in 0.408s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fb280cef-f587-415a-a254-3b617764c566 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81.8314a59c-9974-4354-bc4a-c93614666502 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:36 devstack sudo[92853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81.8314a59c-9974-4354-bc4a-c93614666502 1G Jul 21 02:10:36 devstack sudo[92853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:37 devstack sudo[92853]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fb280cef-f587-415a-a254-3b617764c566 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81.8314a59c-9974-4354-bc4a-c93614666502 1G" returned: 0 in 0.622s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fb280cef-f587-415a-a254-3b617764c566 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81.8314a59c-9974-4354-bc4a-c93614666502 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:37 devstack sudo[92860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81.8314a59c-9974-4354-bc4a-c93614666502 Jul 21 02:10:37 devstack sudo[92860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:37 devstack sudo[92860]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fb280cef-f587-415a-a254-3b617764c566 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81.8314a59c-9974-4354-bc4a-c93614666502" returned: 0 in 0.385s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:37 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-fb280cef-f587-415a-a254-3b617764c566 tempest-GroupSnapshotsTest-1636033596 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81.8314a59c-9974-4354-bc4a-c93614666502 is being set with open permissions: ugo+rw: NotImplementedError Jul 21 02:10:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fb280cef-f587-415a-a254-3b617764c566 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81.8314a59c-9974-4354-bc4a-c93614666502 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:37 devstack sudo[92865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81.8314a59c-9974-4354-bc4a-c93614666502 Jul 21 02:10:37 devstack sudo[92865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:38 devstack sudo[92865]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fb280cef-f587-415a-a254-3b617764c566 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81.8314a59c-9974-4354-bc4a-c93614666502" returned: 0 in 0.317s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fb280cef-f587-415a-a254-3b617764c566 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:38 devstack sudo[92868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81.info Jul 21 02:10:38 devstack sudo[92868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:38 devstack sudo[92868]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fb280cef-f587-415a-a254-3b617764c566 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81.info" returned: 0 in 0.399s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:38 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-fb280cef-f587-415a-a254-3b617764c566 tempest-GroupSnapshotsTest-1636033596 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 02:10:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fb280cef-f587-415a-a254-3b617764c566 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:38 devstack sudo[92871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81.info Jul 21 02:10:38 devstack sudo[92871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:38 devstack sudo[92871]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fb280cef-f587-415a-a254-3b617764c566 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81.info" returned: 0 in 0.442s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-fb280cef-f587-415a-a254-3b617764c566 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.708s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:10:39 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-fb280cef-f587-415a-a254-3b617764c566 tempest-GroupSnapshotsTest-1636033596 None] group_snapshot 38e08403-7ec0-483d-a30e-c6d2e1233ef4: created successfully Jul 21 02:10:39 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-aa1a234e-20ce-4637-acf1-e70fb3800775 tempest-GroupSnapshotsTest-1636033596 None] group_snapshot 38e08403-7ec0-483d-a30e-c6d2e1233ef4: deleting Jul 21 02:10:39 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-aa1a234e-20ce-4637-acf1-e70fb3800775 tempest-GroupSnapshotsTest-1636033596 None] group_snapshot 38e08403-7ec0-483d-a30e-c6d2e1233ef4: deleting {{(pid=87566) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 21 02:10:39 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-aa1a234e-20ce-4637-acf1-e70fb3800775 tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "cinder-quobyte-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:10:39 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-aa1a234e-20ce-4637-acf1-e70fb3800775 tempest-GroupSnapshotsTest-1636033596 None] Lock "cinder-quobyte-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:10:39 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-aa1a234e-20ce-4637-acf1-e70fb3800775 tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "cinder-quobyte-8314a59c-9974-4354-bc4a-c93614666502" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:10:39 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-aa1a234e-20ce-4637-acf1-e70fb3800775 tempest-GroupSnapshotsTest-1636033596 None] Lock "cinder-quobyte-8314a59c-9974-4354-bc4a-c93614666502" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:10:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-aa1a234e-20ce-4637-acf1-e70fb3800775 tempest-GroupSnapshotsTest-1636033596 None] Deleting offline snapshot 8314a59c-9974-4354-bc4a-c93614666502 of volume 5b80f2e9-f3be-4fd5-a226-e94c0a31ef81 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:10:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-aa1a234e-20ce-4637-acf1-e70fb3800775 tempest-GroupSnapshotsTest-1636033596 None] snapshot_file for this snap is: volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81.8314a59c-9974-4354-bc4a-c93614666502 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:10:39 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb7cfde-f149-4ae0-b559-7bd2bbeaa29d]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:10:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-aa1a234e-20ce-4637-acf1-e70fb3800775 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81.8314a59c-9974-4354-bc4a-c93614666502 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:40 devstack sudo[92913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81.8314a59c-9974-4354-bc4a-c93614666502 Jul 21 02:10:40 devstack sudo[92913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:40 devstack sudo[92913]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-aa1a234e-20ce-4637-acf1-e70fb3800775 tempest-GroupSnapshotsTest-1636033596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81.8314a59c-9974-4354-bc4a-c93614666502" returned: 0 in 0.570s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:40 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-aa1a234e-20ce-4637-acf1-e70fb3800775 tempest-GroupSnapshotsTest-1636033596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:10:40 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[5557139c-96c0-4bfd-8aa1-f681a987295c]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:10:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-aa1a234e-20ce-4637-acf1-e70fb3800775 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:40 devstack sudo[92925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81 Jul 21 02:10:40 devstack sudo[92925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:41 devstack sudo[92925]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-aa1a234e-20ce-4637-acf1-e70fb3800775 tempest-GroupSnapshotsTest-1636033596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81" returned: 0 in 0.846s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-aa1a234e-20ce-4637-acf1-e70fb3800775 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81.8314a59c-9974-4354-bc4a-c93614666502 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:41 devstack sudo[92931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81.8314a59c-9974-4354-bc4a-c93614666502 Jul 21 02:10:41 devstack sudo[92931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:42 devstack sudo[92931]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-aa1a234e-20ce-4637-acf1-e70fb3800775 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81.8314a59c-9974-4354-bc4a-c93614666502" returned: 0 in 1.063s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-aa1a234e-20ce-4637-acf1-e70fb3800775 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81.8314a59c-9974-4354-bc4a-c93614666502 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:42 devstack sudo[92975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81.8314a59c-9974-4354-bc4a-c93614666502 Jul 21 02:10:42 devstack sudo[92975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:43 devstack sudo[92975]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-aa1a234e-20ce-4637-acf1-e70fb3800775 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81.8314a59c-9974-4354-bc4a-c93614666502" returned: 0 in 0.703s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:43 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-aa1a234e-20ce-4637-acf1-e70fb3800775 tempest-GroupSnapshotsTest-1636033596 None] Lock "cinder-quobyte-8314a59c-9974-4354-bc4a-c93614666502" released by "_delete_snapshot" :: held 3.467s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:10:43 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-aa1a234e-20ce-4637-acf1-e70fb3800775 tempest-GroupSnapshotsTest-1636033596 None] Lock "cinder-quobyte-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81" released by "delete_snapshot" :: held 3.528s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:10:43 devstack cinder-volume[87566]: WARNING cinder.quota [None req-aa1a234e-20ce-4637-acf1-e70fb3800775 tempest-GroupSnapshotsTest-1636033596 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1457178520 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1457178520, it is now deprecated. Please use the default quota class for default quota. Jul 21 02:10:43 devstack cinder-volume[87566]: WARNING cinder.quota [None req-aa1a234e-20ce-4637-acf1-e70fb3800775 tempest-GroupSnapshotsTest-1636033596 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1457178520 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1457178520, it is now deprecated. Please use the default quota class for default quota. Jul 21 02:10:43 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-aa1a234e-20ce-4637-acf1-e70fb3800775 tempest-GroupSnapshotsTest-1636033596 None] Created reservations ['0f3f7387-85a1-4d47-85d6-f295f342d8a5', '20b21b58-1ac3-472f-b12f-b1f1736e52fb', 'd621239c-cefe-4516-8ecd-213d309c6917', 'e2305951-f8aa-4014-b8f2-fdccca2865c8'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:10:43 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-aa1a234e-20ce-4637-acf1-e70fb3800775 tempest-GroupSnapshotsTest-1636033596 None] group_snapshot 38e08403-7ec0-483d-a30e-c6d2e1233ef4: deleted successfully Jul 21 02:10:45 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-400b18c9-435c-4f9a-818f-2f4f0b909826 tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "cinder-quobyte-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:10:45 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-400b18c9-435c-4f9a-818f-2f4f0b909826 tempest-GroupSnapshotsTest-1636033596 None] Lock "cinder-quobyte-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81" acquired by "delete_volume" :: waited 0.030s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:10:45 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d58ba6a-4222-45de-8dd4-c49f97cd16a0]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:10:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-400b18c9-435c-4f9a-818f-2f4f0b909826 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:45 devstack sudo[93019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81 Jul 21 02:10:45 devstack sudo[93019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:45 devstack sudo[93019]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-400b18c9-435c-4f9a-818f-2f4f0b909826 tempest-GroupSnapshotsTest-1636033596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81" returned: 0 in 0.604s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-400b18c9-435c-4f9a-818f-2f4f0b909826 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:45 devstack sudo[93028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81 Jul 21 02:10:45 devstack sudo[93028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:46 devstack sudo[93028]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-400b18c9-435c-4f9a-818f-2f4f0b909826 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81" returned: 0 in 0.287s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:46 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-400b18c9-435c-4f9a-818f-2f4f0b909826 tempest-GroupSnapshotsTest-1636033596 None] Lock "cinder-quobyte-5b80f2e9-f3be-4fd5-a226-e94c0a31ef81" released by "delete_volume" :: held 1.030s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:10:46 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-400b18c9-435c-4f9a-818f-2f4f0b909826 tempest-GroupSnapshotsTest-1636033596 None] Created reservations ['2f26b5dc-ff41-4711-a08f-7f0817b52815'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:10:46 devstack cinder-volume[87566]: WARNING cinder.quota [None req-400b18c9-435c-4f9a-818f-2f4f0b909826 tempest-GroupSnapshotsTest-1636033596 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1457178520 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1457178520, it is now deprecated. Please use the default quota class for default quota. Jul 21 02:10:46 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-400b18c9-435c-4f9a-818f-2f4f0b909826 tempest-GroupSnapshotsTest-1636033596 None] Created reservations ['dd86f822-1bb9-4ddb-bca2-e2217d99e0e7', '4c43832f-4c48-4c95-92f6-3eb763c054f2', 'ff19377f-930a-4078-b685-5d775ac74a9a', 'ca669b01-2c3e-4fe6-b354-b72079d1a5f4'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:10:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-400b18c9-435c-4f9a-818f-2f4f0b909826 tempest-GroupSnapshotsTest-1636033596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:10:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-400b18c9-435c-4f9a-818f-2f4f0b909826 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:10:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-400b18c9-435c-4f9a-818f-2f4f0b909826 tempest-GroupSnapshotsTest-1636033596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:10:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-400b18c9-435c-4f9a-818f-2f4f0b909826 tempest-GroupSnapshotsTest-1636033596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:10:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-400b18c9-435c-4f9a-818f-2f4f0b909826 tempest-GroupSnapshotsTest-1636033596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:10:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-400b18c9-435c-4f9a-818f-2f4f0b909826 tempest-GroupSnapshotsTest-1636033596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:46 devstack sudo[93065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:10:46 devstack sudo[93065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:47 devstack sudo[93065]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-400b18c9-435c-4f9a-818f-2f4f0b909826 tempest-GroupSnapshotsTest-1636033596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.573s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:47 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-400b18c9-435c-4f9a-818f-2f4f0b909826 tempest-GroupSnapshotsTest-1636033596 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:10:47 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-400b18c9-435c-4f9a-818f-2f4f0b909826 tempest-GroupSnapshotsTest-1636033596 None] Delete group completed successfully. Jul 21 02:10:48 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:10:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:10:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:10:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:10:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:10:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:10:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:49 devstack sudo[93111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:10:49 devstack sudo[93111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:49 devstack sudo[93111]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 1.003s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:49 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:10:49 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager._thread_info {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:10:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread count: 8 {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 02:10:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread info: [<_MainThread(MainThread, started 135786703114368)>, , , , , , , ] {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 02:10:56 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:UPDATE=139,cinder:SELECT=137,cinder:INSERT=23,cinder:DELETE=6 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:10:56 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:10:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] Flow 'volume_create_manager' (71af2c07-bbd2-49bb-88fc-e0fd3b412eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:10:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a25514-d2dd-4d53-9e08-aae372a25e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:10:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a25514-d2dd-4d53-9e08-aae372a25e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-963344287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e9d5b0a-bbf0-4926-9811-754663a82d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf51711cf25451d866d702be43d9754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:10:56Z,use_quota=True,user_id='5fd7438e660448c58ba7c960765b76e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ae9844-6330-4b0d-8b89-368298c2dc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:10:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ae9844-6330-4b0d-8b89-368298c2dc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738ed392-9b0e-4e56-8b8a-7dfc5c979815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:10:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738ed392-9b0e-4e56-8b8a-7dfc5c979815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e9d5b0a-bbf0-4926-9811-754663a82d6f', 'volume_name': 'volume-2e9d5b0a-bbf0-4926-9811-754663a82d6f', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e7742bf-5ade-43b2-b4a0-df6e35dfd98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:10:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e7742bf-5ade-43b2-b4a0-df6e35dfd98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a53cd10b-a740-4b5d-a66a-b59f8a048138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:10:56 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] Volume 2e9d5b0a-bbf0-4926-9811-754663a82d6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e9d5b0a-bbf0-4926-9811-754663a82d6f', 'volume_size': 1} Jul 21 02:10:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:10:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:10:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-963344287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e9d5b0a-bbf0-4926-9811-754663a82d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf51711cf25451d866d702be43d9754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:10:56Z,use_quota=True,user_id='5fd7438e660448c58ba7c960765b76e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:10:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] Creating volume 2e9d5b0a-bbf0-4926-9811-754663a82d6f {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:10:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:10:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:10:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:10:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:10:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:10:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:10:56 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:10:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2e9d5b0a-bbf0-4926-9811-754663a82d6f 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:56 devstack sudo[93182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2e9d5b0a-bbf0-4926-9811-754663a82d6f 1073741824 Jul 21 02:10:56 devstack sudo[93182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:57 devstack sudo[93182]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2e9d5b0a-bbf0-4926-9811-754663a82d6f 1073741824" returned: 0 in 0.523s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2e9d5b0a-bbf0-4926-9811-754663a82d6f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:10:57 devstack sudo[93188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2e9d5b0a-bbf0-4926-9811-754663a82d6f Jul 21 02:10:57 devstack sudo[93188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:10:57 devstack sudo[93188]: pam_unix(sudo:session): session closed for user root Jul 21 02:10:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2e9d5b0a-bbf0-4926-9811-754663a82d6f" returned: 0 in 0.345s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:10:57 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:10:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:10:57 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a53cd10b-a740-4b5d-a66a-b59f8a048138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e9d5b0a-bbf0-4926-9811-754663a82d6f', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:57 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (259a3cfc-ca32-4883-8df9-2d13f9d2b8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:10:57 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] Volume volume-2e9d5b0a-bbf0-4926-9811-754663a82d6f (2e9d5b0a-bbf0-4926-9811-754663a82d6f): created successfully Jul 21 02:10:57 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (259a3cfc-ca32-4883-8df9-2d13f9d2b8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:10:57 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] Flow 'volume_create_manager' (71af2c07-bbd2-49bb-88fc-e0fd3b412eb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:10:57 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-00ed5bf9-58a9-4ad0-9b5f-0c30fff98afb tempest-VolumesActionsTest-536708301 None] Created volume successfully. Jul 21 02:10:58 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-6016741d-d091-4072-82f8-61b1c7af2fb4 tempest-GroupsTest-563796064 None] Group tempest-Group1-896142343: creating Jul 21 02:10:58 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-6016741d-d091-4072-82f8-61b1c7af2fb4 tempest-GroupsTest-563796064 None] Group tempest-Group1-896142343: created successfully Jul 21 02:10:58 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-6016741d-d091-4072-82f8-61b1c7af2fb4 tempest-GroupsTest-563796064 None] Create group completed successfully. Jul 21 02:10:58 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b07ab7dd-8758-4807-a6e9-f603bda89f01 tempest-VolumesActionsTest-536708301 None] Acquiring lock "cinder-2e9d5b0a-bbf0-4926-9811-754663a82d6f" by "attach_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:10:58 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b07ab7dd-8758-4807-a6e9-f603bda89f01 tempest-VolumesActionsTest-536708301 None] Lock "cinder-2e9d5b0a-bbf0-4926-9811-754663a82d6f" acquired by "attach_volume" :: waited 0.022s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:10:58 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-b07ab7dd-8758-4807-a6e9-f603bda89f01 tempest-VolumesActionsTest-536708301 None] Attaching volume 2e9d5b0a-bbf0-4926-9811-754663a82d6f to instance 689ce33d-a876-43dc-879e-ed200b618252 at mountpoint /dev/vdb on host None. Jul 21 02:10:58 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-b07ab7dd-8758-4807-a6e9-f603bda89f01 tempest-VolumesActionsTest-536708301 None] Attach volume completed successfully. Jul 21 02:10:58 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b07ab7dd-8758-4807-a6e9-f603bda89f01 tempest-VolumesActionsTest-536708301 None] Lock "cinder-2e9d5b0a-bbf0-4926-9811-754663a82d6f" released by "attach_volume" :: held 0.133s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:10:59 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-9d34e99f-5919-4557-b589-e61a0616f813 tempest-VolumesActionsTest-474493896 None] Terminate volume connection completed successfully. Jul 21 02:10:59 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9d34e99f-5919-4557-b589-e61a0616f813 tempest-VolumesActionsTest-474493896 None] Acquiring lock "cinder-2e9d5b0a-bbf0-4926-9811-754663a82d6f-detach_volume" by "detach_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:10:59 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9d34e99f-5919-4557-b589-e61a0616f813 tempest-VolumesActionsTest-474493896 None] Lock "cinder-2e9d5b0a-bbf0-4926-9811-754663a82d6f-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:10:59 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-9d34e99f-5919-4557-b589-e61a0616f813 tempest-VolumesActionsTest-474493896 None] Detaching volume 2e9d5b0a-bbf0-4926-9811-754663a82d6f from instance 689ce33d-a876-43dc-879e-ed200b618252. Jul 21 02:10:59 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-9d34e99f-5919-4557-b589-e61a0616f813 tempest-VolumesActionsTest-474493896 None] Detach volume completed successfully. Jul 21 02:10:59 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9d34e99f-5919-4557-b589-e61a0616f813 tempest-VolumesActionsTest-474493896 None] Lock "cinder-2e9d5b0a-bbf0-4926-9811-754663a82d6f-detach_volume" released by "detach_volume" :: held 0.085s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:10:59 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-401422ae-a8cf-4972-af3d-f66d6922df54 tempest-VolumesActionsTest-536708301 None] Acquiring lock "cinder-2e9d5b0a-bbf0-4926-9811-754663a82d6f-detach_volume" by "detach_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:10:59 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-ae8dc436-1fc7-4fd8-91d0-c024f49c11a3 tempest-GroupsTest-563796064 None] Group tempest-Group2-638951946: creating Jul 21 02:10:59 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-401422ae-a8cf-4972-af3d-f66d6922df54 tempest-VolumesActionsTest-536708301 None] Lock "cinder-2e9d5b0a-bbf0-4926-9811-754663a82d6f-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:10:59 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-401422ae-a8cf-4972-af3d-f66d6922df54 tempest-VolumesActionsTest-536708301 None] Volume detach called, but volume not attached. Jul 21 02:10:59 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-ae8dc436-1fc7-4fd8-91d0-c024f49c11a3 tempest-GroupsTest-563796064 None] Group tempest-Group2-638951946: created successfully Jul 21 02:10:59 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-401422ae-a8cf-4972-af3d-f66d6922df54 tempest-VolumesActionsTest-536708301 None] Lock "cinder-2e9d5b0a-bbf0-4926-9811-754663a82d6f-detach_volume" released by "detach_volume" :: held 0.039s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:10:59 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-ae8dc436-1fc7-4fd8-91d0-c024f49c11a3 tempest-GroupsTest-563796064 None] Create group completed successfully. Jul 21 02:11:00 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-01689258-1393-4d90-8863-3928e3beceeb tempest-VolumesActionsTest-536708301 None] Acquiring lock "cinder-2e9d5b0a-bbf0-4926-9811-754663a82d6f-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:11:00 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-01689258-1393-4d90-8863-3928e3beceeb tempest-VolumesActionsTest-536708301 None] Lock "cinder-2e9d5b0a-bbf0-4926-9811-754663a82d6f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:11:00 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-01689258-1393-4d90-8863-3928e3beceeb tempest-VolumesActionsTest-536708301 None] Acquiring lock "cinder-quobyte-2e9d5b0a-bbf0-4926-9811-754663a82d6f" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:11:00 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-01689258-1393-4d90-8863-3928e3beceeb tempest-VolumesActionsTest-536708301 None] Lock "cinder-quobyte-2e9d5b0a-bbf0-4926-9811-754663a82d6f" acquired by "delete_volume" :: waited 0.022s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:11:00 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a38aa62-3196-483c-9290-2bc969f543e3]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:11:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-01689258-1393-4d90-8863-3928e3beceeb tempest-VolumesActionsTest-536708301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2e9d5b0a-bbf0-4926-9811-754663a82d6f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:00 devstack sudo[93191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2e9d5b0a-bbf0-4926-9811-754663a82d6f Jul 21 02:11:00 devstack sudo[93191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:00 devstack sudo[93191]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-01689258-1393-4d90-8863-3928e3beceeb tempest-VolumesActionsTest-536708301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2e9d5b0a-bbf0-4926-9811-754663a82d6f" returned: 0 in 0.387s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-01689258-1393-4d90-8863-3928e3beceeb tempest-VolumesActionsTest-536708301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2e9d5b0a-bbf0-4926-9811-754663a82d6f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:00 devstack sudo[93196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2e9d5b0a-bbf0-4926-9811-754663a82d6f Jul 21 02:11:00 devstack sudo[93196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:00 devstack sudo[93196]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-01689258-1393-4d90-8863-3928e3beceeb tempest-VolumesActionsTest-536708301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2e9d5b0a-bbf0-4926-9811-754663a82d6f" returned: 0 in 0.290s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:00 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-01689258-1393-4d90-8863-3928e3beceeb tempest-VolumesActionsTest-536708301 None] Lock "cinder-quobyte-2e9d5b0a-bbf0-4926-9811-754663a82d6f" released by "delete_volume" :: held 0.720s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:11:00 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-01689258-1393-4d90-8863-3928e3beceeb tempest-VolumesActionsTest-536708301 None] Created reservations ['7a4da4a0-c3e9-4cd9-80a2-13fcc560d977', '6fd53f28-8cb9-4eae-b87c-3ca9b9e01009', '397436f9-8804-476a-b321-60fc53c0555f', 'ed402b5c-b9af-4e95-b788-5d5327743884'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:11:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-01689258-1393-4d90-8863-3928e3beceeb tempest-VolumesActionsTest-536708301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-01689258-1393-4d90-8863-3928e3beceeb tempest-VolumesActionsTest-536708301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:01 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-01689258-1393-4d90-8863-3928e3beceeb tempest-VolumesActionsTest-536708301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:11:01 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-01689258-1393-4d90-8863-3928e3beceeb tempest-VolumesActionsTest-536708301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:11:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-01689258-1393-4d90-8863-3928e3beceeb tempest-VolumesActionsTest-536708301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-01689258-1393-4d90-8863-3928e3beceeb tempest-VolumesActionsTest-536708301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:01 devstack sudo[93199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:11:01 devstack sudo[93199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:01 devstack sudo[93199]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-01689258-1393-4d90-8863-3928e3beceeb tempest-VolumesActionsTest-536708301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.422s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:01 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-01689258-1393-4d90-8863-3928e3beceeb tempest-VolumesActionsTest-536708301 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:11:01 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-01689258-1393-4d90-8863-3928e3beceeb tempest-VolumesActionsTest-536708301 None] Deleted volume successfully. Jul 21 02:11:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-01689258-1393-4d90-8863-3928e3beceeb tempest-VolumesActionsTest-536708301 None] Lock "cinder-2e9d5b0a-bbf0-4926-9811-754663a82d6f-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:11:01 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:11:01 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] Flow 'volume_create_manager' (b0dacc17-2bfa-4581-ac74-dece9320b5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:11:01 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8513ed8-cc3e-4004-8254-a41a69902559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:02 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8513ed8-cc3e-4004-8254-a41a69902559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-354931721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=30cb6d98-fdfe-4377-94ad-96bae2cd1712,host='devstack@QuobyteHD#QuobyteHD',id=ba416c32-1120-4f0b-8dff-b25f35e2ad6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a574237c6a41be8d2f04f1fe3503ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:11:02Z,use_quota=True,user_id='4701c97580a9411ca1f8a0a1670316e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(104d3c12-3b34-4518-b490-d1c13707cec9),volume_type_id=104d3c12-3b34-4518-b490-d1c13707cec9)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:02 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5f90605-9dba-43b2-9511-44a70270ccc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:02 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5f90605-9dba-43b2-9511-44a70270ccc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:02 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (849ca276-058c-4706-a96c-872c2d338aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:02 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (849ca276-058c-4706-a96c-872c2d338aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba416c32-1120-4f0b-8dff-b25f35e2ad6f', 'volume_name': 'volume-ba416c32-1120-4f0b-8dff-b25f35e2ad6f', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:02 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3575a400-cb05-4c20-9aa4-32a2695d7ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:02 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3575a400-cb05-4c20-9aa4-32a2695d7ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:02 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b834545b-e860-4e23-9106-932f68199614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:02 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] Volume ba416c32-1120-4f0b-8dff-b25f35e2ad6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba416c32-1120-4f0b-8dff-b25f35e2ad6f', 'volume_size': 1} Jul 21 02:11:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:02 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=30cb6d98-fdfe-4377-94ad-96bae2cd1712,created_at=2026-07-21T00:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-354931721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=30cb6d98-fdfe-4377-94ad-96bae2cd1712,host='devstack@QuobyteHD#QuobyteHD',id=ba416c32-1120-4f0b-8dff-b25f35e2ad6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a574237c6a41be8d2f04f1fe3503ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:11:02Z,use_quota=True,user_id='4701c97580a9411ca1f8a0a1670316e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(104d3c12-3b34-4518-b490-d1c13707cec9),volume_type_id=104d3c12-3b34-4518-b490-d1c13707cec9)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:11:02 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] Creating volume ba416c32-1120-4f0b-8dff-b25f35e2ad6f {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:11:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:02 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:11:02 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:11:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:02 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:11:02 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:11:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ba416c32-1120-4f0b-8dff-b25f35e2ad6f 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:02 devstack sudo[93220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ba416c32-1120-4f0b-8dff-b25f35e2ad6f 1073741824 Jul 21 02:11:02 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:02 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ba416c32-1120-4f0b-8dff-b25f35e2ad6f 1073741824" returned: 0 in 0.777s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ba416c32-1120-4f0b-8dff-b25f35e2ad6f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:03 devstack sudo[93250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ba416c32-1120-4f0b-8dff-b25f35e2ad6f Jul 21 02:11:03 devstack sudo[93250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:03 devstack sudo[93250]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ba416c32-1120-4f0b-8dff-b25f35e2ad6f" returned: 0 in 0.427s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:03 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:11:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:03 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b834545b-e860-4e23-9106-932f68199614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba416c32-1120-4f0b-8dff-b25f35e2ad6f', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:03 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f668e4-43f9-4bed-ba46-0be4c0637874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:03 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] Volume volume-ba416c32-1120-4f0b-8dff-b25f35e2ad6f (ba416c32-1120-4f0b-8dff-b25f35e2ad6f): created successfully Jul 21 02:11:03 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f668e4-43f9-4bed-ba46-0be4c0637874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:03 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] Flow 'volume_create_manager' (b0dacc17-2bfa-4581-ac74-dece9320b5fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:11:03 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-5d0f078a-ea14-4a2d-9fa6-6a52b7c5a8fd tempest-GroupsTest-563796064 None] Created volume successfully. Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6526906e-c47d-4de7-9d87-7b43780f2548 tempest-GroupsTest-563796064 None] Acquiring lock "cinder-quobyte-ba416c32-1120-4f0b-8dff-b25f35e2ad6f" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6526906e-c47d-4de7-9d87-7b43780f2548 tempest-GroupsTest-563796064 None] Lock "cinder-quobyte-ba416c32-1120-4f0b-8dff-b25f35e2ad6f" acquired by "delete_volume" :: waited 0.020s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d8fe66-e99e-4e6b-9e3a-19ba6f1182f5]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6526906e-c47d-4de7-9d87-7b43780f2548 tempest-GroupsTest-563796064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ba416c32-1120-4f0b-8dff-b25f35e2ad6f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:05 devstack sudo[93261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ba416c32-1120-4f0b-8dff-b25f35e2ad6f Jul 21 02:11:05 devstack sudo[93261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] Flow 'volume_create_manager' (62492f4a-089f-42db-943a-1ba65a7df570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42227ab5-e2f9-409d-968d-9744ec475fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42227ab5-e2f9-409d-968d-9744ec475fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1969893879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a71d1c71-e37e-4b1f-a1f7-d6bfc318d2eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf51711cf25451d866d702be43d9754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:11:05Z,use_quota=True,user_id='5fd7438e660448c58ba7c960765b76e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b13376f4-b881-407f-844a-f690e7b08491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b13376f4-b881-407f-844a-f690e7b08491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26511221-7145-4eaf-9994-edd307b24228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26511221-7145-4eaf-9994-edd307b24228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a71d1c71-e37e-4b1f-a1f7-d6bfc318d2eb', 'volume_name': 'volume-a71d1c71-e37e-4b1f-a1f7-d6bfc318d2eb', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bedbc62-ab60-4d73-901d-4e211e94879b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bedbc62-ab60-4d73-901d-4e211e94879b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc3c531-b172-4fef-8596-fb2fde99df42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:05 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] Volume a71d1c71-e37e-4b1f-a1f7-d6bfc318d2eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a71d1c71-e37e-4b1f-a1f7-d6bfc318d2eb', 'volume_size': 1} Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1969893879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a71d1c71-e37e-4b1f-a1f7-d6bfc318d2eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf51711cf25451d866d702be43d9754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:11:05Z,use_quota=True,user_id='5fd7438e660448c58ba7c960765b76e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] Creating volume a71d1c71-e37e-4b1f-a1f7-d6bfc318d2eb {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:11:05 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a71d1c71-e37e-4b1f-a1f7-d6bfc318d2eb 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:05 devstack sudo[93263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a71d1c71-e37e-4b1f-a1f7-d6bfc318d2eb 1073741824 Jul 21 02:11:05 devstack sudo[93263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:05 devstack sudo[93261]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6526906e-c47d-4de7-9d87-7b43780f2548 tempest-GroupsTest-563796064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ba416c32-1120-4f0b-8dff-b25f35e2ad6f" returned: 0 in 0.392s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6526906e-c47d-4de7-9d87-7b43780f2548 tempest-GroupsTest-563796064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ba416c32-1120-4f0b-8dff-b25f35e2ad6f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:05 devstack sudo[93268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ba416c32-1120-4f0b-8dff-b25f35e2ad6f Jul 21 02:11:05 devstack sudo[93268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:05 devstack sudo[93268]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6526906e-c47d-4de7-9d87-7b43780f2548 tempest-GroupsTest-563796064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ba416c32-1120-4f0b-8dff-b25f35e2ad6f" returned: 0 in 0.247s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6526906e-c47d-4de7-9d87-7b43780f2548 tempest-GroupsTest-563796064 None] Lock "cinder-quobyte-ba416c32-1120-4f0b-8dff-b25f35e2ad6f" released by "delete_volume" :: held 0.701s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:11:05 devstack sudo[93263]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a71d1c71-e37e-4b1f-a1f7-d6bfc318d2eb 1073741824" returned: 0 in 0.444s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-6526906e-c47d-4de7-9d87-7b43780f2548 tempest-GroupsTest-563796064 None] Created reservations ['0876227b-f67c-4e7f-80a7-9ad1231f2b92'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a71d1c71-e37e-4b1f-a1f7-d6bfc318d2eb {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:05 devstack cinder-volume[87566]: WARNING cinder.quota [None req-6526906e-c47d-4de7-9d87-7b43780f2548 tempest-GroupsTest-563796064 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1305858960 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1305858960, it is now deprecated. Please use the default quota class for default quota. Jul 21 02:11:05 devstack cinder-volume[87566]: WARNING cinder.quota [None req-6526906e-c47d-4de7-9d87-7b43780f2548 tempest-GroupsTest-563796064 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1305858960 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1305858960, it is now deprecated. Please use the default quota class for default quota. Jul 21 02:11:05 devstack sudo[93274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a71d1c71-e37e-4b1f-a1f7-d6bfc318d2eb Jul 21 02:11:05 devstack sudo[93274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:05 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-6526906e-c47d-4de7-9d87-7b43780f2548 tempest-GroupsTest-563796064 None] Created reservations ['fe429d81-9076-49f9-951e-e9b1e70a98bc', '12567a58-4ca3-4e12-bcae-9beb817adb1a', 'c19cdb80-3273-45ef-b324-833048dd30ab', 'd8338439-149a-4286-a156-6bc0113c085d'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:11:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6526906e-c47d-4de7-9d87-7b43780f2548 tempest-GroupsTest-563796064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6526906e-c47d-4de7-9d87-7b43780f2548 tempest-GroupsTest-563796064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:06 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-6526906e-c47d-4de7-9d87-7b43780f2548 tempest-GroupsTest-563796064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:11:06 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-6526906e-c47d-4de7-9d87-7b43780f2548 tempest-GroupsTest-563796064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:11:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6526906e-c47d-4de7-9d87-7b43780f2548 tempest-GroupsTest-563796064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6526906e-c47d-4de7-9d87-7b43780f2548 tempest-GroupsTest-563796064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:06 devstack sudo[93276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:11:06 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:06 devstack sudo[93274]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a71d1c71-e37e-4b1f-a1f7-d6bfc318d2eb" returned: 0 in 0.274s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:06 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:11:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc3c531-b172-4fef-8596-fb2fde99df42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a71d1c71-e37e-4b1f-a1f7-d6bfc318d2eb', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac067f3a-e806-4469-92dc-4d3f1527b245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:06 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] Volume volume-a71d1c71-e37e-4b1f-a1f7-d6bfc318d2eb (a71d1c71-e37e-4b1f-a1f7-d6bfc318d2eb): created successfully Jul 21 02:11:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac067f3a-e806-4469-92dc-4d3f1527b245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] Flow 'volume_create_manager' (62492f4a-089f-42db-943a-1ba65a7df570) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:11:06 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-b71c8039-566e-4a60-8f43-5d1c30a221ea tempest-VolumesActionsTest-536708301 None] Created volume successfully. Jul 21 02:11:06 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6526906e-c47d-4de7-9d87-7b43780f2548 tempest-GroupsTest-563796064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.292s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:06 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-6526906e-c47d-4de7-9d87-7b43780f2548 tempest-GroupsTest-563796064 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:11:06 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-6526906e-c47d-4de7-9d87-7b43780f2548 tempest-GroupsTest-563796064 None] Delete group completed successfully. Jul 21 02:11:06 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-03ac5813-60a6-482e-86c0-cda7844084fa tempest-GroupsTest-563796064 None] Created reservations ['a3927941-c1bd-4388-af0e-134e6380b09b'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:11:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-03ac5813-60a6-482e-86c0-cda7844084fa tempest-GroupsTest-563796064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-03ac5813-60a6-482e-86c0-cda7844084fa tempest-GroupsTest-563796064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:06 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-03ac5813-60a6-482e-86c0-cda7844084fa tempest-GroupsTest-563796064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:11:06 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-03ac5813-60a6-482e-86c0-cda7844084fa tempest-GroupsTest-563796064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:11:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-03ac5813-60a6-482e-86c0-cda7844084fa tempest-GroupsTest-563796064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-03ac5813-60a6-482e-86c0-cda7844084fa tempest-GroupsTest-563796064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:06 devstack sudo[93280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:11:06 devstack sudo[93280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:06 devstack sudo[93280]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-03ac5813-60a6-482e-86c0-cda7844084fa tempest-GroupsTest-563796064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.255s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:06 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-03ac5813-60a6-482e-86c0-cda7844084fa tempest-GroupsTest-563796064 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:11:06 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-03ac5813-60a6-482e-86c0-cda7844084fa tempest-GroupsTest-563796064 None] Delete group completed successfully. Jul 21 02:11:07 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-89e30a29-43d0-4042-9a46-435ba7070fb9 tempest-VolumesActionsTest-474493896 None] Acquiring lock "cinder-a71d1c71-e37e-4b1f-a1f7-d6bfc318d2eb-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:11:07 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-89e30a29-43d0-4042-9a46-435ba7070fb9 tempest-VolumesActionsTest-474493896 None] Lock "cinder-a71d1c71-e37e-4b1f-a1f7-d6bfc318d2eb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:11:07 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-89e30a29-43d0-4042-9a46-435ba7070fb9 tempest-VolumesActionsTest-474493896 None] Acquiring lock "cinder-quobyte-a71d1c71-e37e-4b1f-a1f7-d6bfc318d2eb" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:11:07 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-89e30a29-43d0-4042-9a46-435ba7070fb9 tempest-VolumesActionsTest-474493896 None] Lock "cinder-quobyte-a71d1c71-e37e-4b1f-a1f7-d6bfc318d2eb" acquired by "delete_volume" :: waited 0.017s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:11:07 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7adffbd-b2dc-4fa3-93cf-bbbcefcf9635]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:11:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-89e30a29-43d0-4042-9a46-435ba7070fb9 tempest-VolumesActionsTest-474493896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a71d1c71-e37e-4b1f-a1f7-d6bfc318d2eb {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:07 devstack sudo[93297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a71d1c71-e37e-4b1f-a1f7-d6bfc318d2eb Jul 21 02:11:07 devstack sudo[93297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:08 devstack sudo[93297]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-89e30a29-43d0-4042-9a46-435ba7070fb9 tempest-VolumesActionsTest-474493896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a71d1c71-e37e-4b1f-a1f7-d6bfc318d2eb" returned: 0 in 0.388s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-89e30a29-43d0-4042-9a46-435ba7070fb9 tempest-VolumesActionsTest-474493896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a71d1c71-e37e-4b1f-a1f7-d6bfc318d2eb {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:08 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-f3e32c04-e812-4474-9164-fa08853f771c tempest-GroupsTest-563796064 None] Group tempest-GroupsTest-Group-1183921342: creating Jul 21 02:11:08 devstack sudo[93303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a71d1c71-e37e-4b1f-a1f7-d6bfc318d2eb Jul 21 02:11:08 devstack sudo[93303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:08 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-f3e32c04-e812-4474-9164-fa08853f771c tempest-GroupsTest-563796064 None] Group tempest-GroupsTest-Group-1183921342: created successfully Jul 21 02:11:08 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-f3e32c04-e812-4474-9164-fa08853f771c tempest-GroupsTest-563796064 None] Create group completed successfully. Jul 21 02:11:08 devstack sudo[93303]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-89e30a29-43d0-4042-9a46-435ba7070fb9 tempest-VolumesActionsTest-474493896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a71d1c71-e37e-4b1f-a1f7-d6bfc318d2eb" returned: 0 in 0.239s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:08 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-89e30a29-43d0-4042-9a46-435ba7070fb9 tempest-VolumesActionsTest-474493896 None] Lock "cinder-quobyte-a71d1c71-e37e-4b1f-a1f7-d6bfc318d2eb" released by "delete_volume" :: held 0.674s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:11:08 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-89e30a29-43d0-4042-9a46-435ba7070fb9 tempest-VolumesActionsTest-474493896 None] Created reservations ['4bdb7f32-e4f8-4c09-b6de-6744d1bcbcc9', 'b27c660c-74a0-446a-a9ef-f99a9af6fbcc', 'bf09a0a7-65bc-4469-b917-1e94fc13cbe2', 'e1de08a1-6ba4-4d42-bba9-f7369ad874b7'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:11:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-89e30a29-43d0-4042-9a46-435ba7070fb9 tempest-VolumesActionsTest-474493896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-89e30a29-43d0-4042-9a46-435ba7070fb9 tempest-VolumesActionsTest-474493896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-89e30a29-43d0-4042-9a46-435ba7070fb9 tempest-VolumesActionsTest-474493896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:11:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-89e30a29-43d0-4042-9a46-435ba7070fb9 tempest-VolumesActionsTest-474493896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:11:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-89e30a29-43d0-4042-9a46-435ba7070fb9 tempest-VolumesActionsTest-474493896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-89e30a29-43d0-4042-9a46-435ba7070fb9 tempest-VolumesActionsTest-474493896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:08 devstack sudo[93306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:11:08 devstack sudo[93306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:08 devstack sudo[93306]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-89e30a29-43d0-4042-9a46-435ba7070fb9 tempest-VolumesActionsTest-474493896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.238s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:08 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-89e30a29-43d0-4042-9a46-435ba7070fb9 tempest-VolumesActionsTest-474493896 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:11:08 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-89e30a29-43d0-4042-9a46-435ba7070fb9 tempest-VolumesActionsTest-474493896 None] Deleted volume successfully. Jul 21 02:11:08 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-89e30a29-43d0-4042-9a46-435ba7070fb9 tempest-VolumesActionsTest-474493896 None] Lock "cinder-a71d1c71-e37e-4b1f-a1f7-d6bfc318d2eb-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:11:09 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:11:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] Flow 'volume_create_manager' (856dae88-110a-4c2e-b2bc-21b83e2059e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:11:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba90fd9-999f-4cb0-a9ad-2cf2058ff9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba90fd9-999f-4cb0-a9ad-2cf2058ff9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1498070629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fdd2f17-bb65-4b42-b102-2545d04024c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf51711cf25451d866d702be43d9754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:11:09Z,use_quota=True,user_id='5fd7438e660448c58ba7c960765b76e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a89304-6b36-4636-9d32-4adf5f1fada5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a89304-6b36-4636-9d32-4adf5f1fada5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42eb7781-473b-4c90-9edc-d2d4906cc2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42eb7781-473b-4c90-9edc-d2d4906cc2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fdd2f17-bb65-4b42-b102-2545d04024c5', 'volume_name': 'volume-5fdd2f17-bb65-4b42-b102-2545d04024c5', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09aa3d5e-57bb-4602-93b7-6eaab71e14d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09aa3d5e-57bb-4602-93b7-6eaab71e14d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16f15df3-56ce-469a-ac6b-23123550e158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:09 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] Volume 5fdd2f17-bb65-4b42-b102-2545d04024c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fdd2f17-bb65-4b42-b102-2545d04024c5', 'volume_size': 1} Jul 21 02:11:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:09 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1498070629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fdd2f17-bb65-4b42-b102-2545d04024c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf51711cf25451d866d702be43d9754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:11:09Z,use_quota=True,user_id='5fd7438e660448c58ba7c960765b76e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:11:09 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] Creating volume 5fdd2f17-bb65-4b42-b102-2545d04024c5 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:11:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:09 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:11:09 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:11:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:09 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:11:09 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:11:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5fdd2f17-bb65-4b42-b102-2545d04024c5 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:09 devstack sudo[93319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5fdd2f17-bb65-4b42-b102-2545d04024c5 1073741824 Jul 21 02:11:09 devstack sudo[93319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:09 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:11:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] Flow 'volume_create_manager' (0888957f-ade5-462d-be7c-4bcf2257209b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:11:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a69b5c1-c18a-4dba-acb5-3881bca65eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a69b5c1-c18a-4dba-acb5-3881bca65eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1916137114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=27912e4b-277e-4677-b089-f682d344c427,host='devstack@QuobyteHD#QuobyteHD',id=c13c301d-3abc-444f-ad93-4d279e6af32d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a574237c6a41be8d2f04f1fe3503ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:11:10Z,use_quota=True,user_id='4701c97580a9411ca1f8a0a1670316e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92478d72-140b-454f-99e8-3c62f96531dc),volume_type_id=92478d72-140b-454f-99e8-3c62f96531dc)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50776a51-34d6-484a-b340-e83fda057a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50776a51-34d6-484a-b340-e83fda057a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ccec0ad-e717-4683-a12f-3149dfba1150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ccec0ad-e717-4683-a12f-3149dfba1150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c13c301d-3abc-444f-ad93-4d279e6af32d', 'volume_name': 'volume-c13c301d-3abc-444f-ad93-4d279e6af32d', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ace43ac-7f11-4211-9ff9-f562a360ed24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ace43ac-7f11-4211-9ff9-f562a360ed24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b2cd2f-4bb8-4b50-a69e-b2c161c6dba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:10 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] Volume c13c301d-3abc-444f-ad93-4d279e6af32d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c13c301d-3abc-444f-ad93-4d279e6af32d', 'volume_size': 1} Jul 21 02:11:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:10 devstack sudo[93319]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5fdd2f17-bb65-4b42-b102-2545d04024c5 1073741824" returned: 0 in 0.833s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5fdd2f17-bb65-4b42-b102-2545d04024c5 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:10 devstack sudo[93350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5fdd2f17-bb65-4b42-b102-2545d04024c5 Jul 21 02:11:10 devstack sudo[93350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:10 devstack sudo[93350]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5fdd2f17-bb65-4b42-b102-2545d04024c5" returned: 0 in 0.309s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:10 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:11:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.593s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:10 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=27912e4b-277e-4677-b089-f682d344c427,created_at=2026-07-21T00:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1916137114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=27912e4b-277e-4677-b089-f682d344c427,host='devstack@QuobyteHD#QuobyteHD',id=c13c301d-3abc-444f-ad93-4d279e6af32d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a574237c6a41be8d2f04f1fe3503ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:11:10Z,use_quota=True,user_id='4701c97580a9411ca1f8a0a1670316e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92478d72-140b-454f-99e8-3c62f96531dc),volume_type_id=92478d72-140b-454f-99e8-3c62f96531dc)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:11:10 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] Creating volume c13c301d-3abc-444f-ad93-4d279e6af32d {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:11:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:10 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:11:10 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:11:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:10 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:11:10 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:11:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c13c301d-3abc-444f-ad93-4d279e6af32d 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16f15df3-56ce-469a-ac6b-23123550e158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fdd2f17-bb65-4b42-b102-2545d04024c5', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:10 devstack sudo[93365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c13c301d-3abc-444f-ad93-4d279e6af32d 1073741824 Jul 21 02:11:10 devstack sudo[93365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dba927a-76e2-4074-8f22-313afe29d4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:10 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] Volume volume-5fdd2f17-bb65-4b42-b102-2545d04024c5 (5fdd2f17-bb65-4b42-b102-2545d04024c5): created successfully Jul 21 02:11:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dba927a-76e2-4074-8f22-313afe29d4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] Flow 'volume_create_manager' (856dae88-110a-4c2e-b2bc-21b83e2059e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:11:10 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-4cb70fc1-51b0-4f22-a22f-aaddd08c5278 tempest-VolumesActionsTest-536708301 None] Created volume successfully. Jul 21 02:11:11 devstack sudo[93365]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c13c301d-3abc-444f-ad93-4d279e6af32d 1073741824" returned: 0 in 0.719s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c13c301d-3abc-444f-ad93-4d279e6af32d {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:11 devstack sudo[93372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c13c301d-3abc-444f-ad93-4d279e6af32d Jul 21 02:11:11 devstack sudo[93372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:11 devstack sudo[93372]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c13c301d-3abc-444f-ad93-4d279e6af32d" returned: 0 in 0.344s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:11 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:11:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b2cd2f-4bb8-4b50-a69e-b2c161c6dba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c13c301d-3abc-444f-ad93-4d279e6af32d', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3f41501-67d8-4e80-9b03-b856015e92a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:11 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-251ff59b-e6cd-44c0-bac6-edd854050060 tempest-VolumesActionsTest-474493896 None] Acquiring lock "cinder-5fdd2f17-bb65-4b42-b102-2545d04024c5-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:11:11 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] Volume volume-c13c301d-3abc-444f-ad93-4d279e6af32d (c13c301d-3abc-444f-ad93-4d279e6af32d): created successfully Jul 21 02:11:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3f41501-67d8-4e80-9b03-b856015e92a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] Flow 'volume_create_manager' (0888957f-ade5-462d-be7c-4bcf2257209b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:11:11 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-251ff59b-e6cd-44c0-bac6-edd854050060 tempest-VolumesActionsTest-474493896 None] Lock "cinder-5fdd2f17-bb65-4b42-b102-2545d04024c5-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:11:11 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-77ec4836-6cd0-42fc-b418-6f9a7c972d3d tempest-GroupsTest-563796064 None] Created volume successfully. Jul 21 02:11:11 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-251ff59b-e6cd-44c0-bac6-edd854050060 tempest-VolumesActionsTest-474493896 None] Acquiring lock "cinder-quobyte-5fdd2f17-bb65-4b42-b102-2545d04024c5" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:11:11 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-251ff59b-e6cd-44c0-bac6-edd854050060 tempest-VolumesActionsTest-474493896 None] Lock "cinder-quobyte-5fdd2f17-bb65-4b42-b102-2545d04024c5" acquired by "delete_volume" :: waited 0.016s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:11:11 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b1785f-3972-4002-a8b9-580416ca1237]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:11:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-251ff59b-e6cd-44c0-bac6-edd854050060 tempest-VolumesActionsTest-474493896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5fdd2f17-bb65-4b42-b102-2545d04024c5 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:12 devstack sudo[93376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5fdd2f17-bb65-4b42-b102-2545d04024c5 Jul 21 02:11:12 devstack sudo[93376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:12 devstack sudo[93376]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-251ff59b-e6cd-44c0-bac6-edd854050060 tempest-VolumesActionsTest-474493896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5fdd2f17-bb65-4b42-b102-2545d04024c5" returned: 0 in 0.430s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-251ff59b-e6cd-44c0-bac6-edd854050060 tempest-VolumesActionsTest-474493896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5fdd2f17-bb65-4b42-b102-2545d04024c5 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:12 devstack sudo[93383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5fdd2f17-bb65-4b42-b102-2545d04024c5 Jul 21 02:11:12 devstack sudo[93383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:12 devstack sudo[93383]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-251ff59b-e6cd-44c0-bac6-edd854050060 tempest-VolumesActionsTest-474493896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5fdd2f17-bb65-4b42-b102-2545d04024c5" returned: 0 in 0.279s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:12 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-251ff59b-e6cd-44c0-bac6-edd854050060 tempest-VolumesActionsTest-474493896 None] Lock "cinder-quobyte-5fdd2f17-bb65-4b42-b102-2545d04024c5" released by "delete_volume" :: held 0.764s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:11:12 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-251ff59b-e6cd-44c0-bac6-edd854050060 tempest-VolumesActionsTest-474493896 None] Created reservations ['68a58af2-5809-49b2-82c8-1fa6e7d8cbeb', '82e1427f-49f0-41a0-a047-91ef9322d21e', '7d1742ff-0705-4f8c-9068-d95bbc8a2629', 'ea7ca7cb-d73d-4bc8-8743-fc3307d88b2f'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:11:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-251ff59b-e6cd-44c0-bac6-edd854050060 tempest-VolumesActionsTest-474493896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-251ff59b-e6cd-44c0-bac6-edd854050060 tempest-VolumesActionsTest-474493896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-251ff59b-e6cd-44c0-bac6-edd854050060 tempest-VolumesActionsTest-474493896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:11:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-251ff59b-e6cd-44c0-bac6-edd854050060 tempest-VolumesActionsTest-474493896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:11:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-251ff59b-e6cd-44c0-bac6-edd854050060 tempest-VolumesActionsTest-474493896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-251ff59b-e6cd-44c0-bac6-edd854050060 tempest-VolumesActionsTest-474493896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:12 devstack sudo[93386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:11:12 devstack sudo[93386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:13 devstack sudo[93386]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] Flow 'volume_create_manager' (3f784eb0-c138-4fe1-a5df-987f3fffbd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e255e2b4-c66e-4817-9b65-8cf9581e442b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-251ff59b-e6cd-44c0-bac6-edd854050060 tempest-VolumesActionsTest-474493896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.357s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-251ff59b-e6cd-44c0-bac6-edd854050060 tempest-VolumesActionsTest-474493896 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e255e2b4-c66e-4817-9b65-8cf9581e442b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1911764780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=27912e4b-277e-4677-b089-f682d344c427,host='devstack@QuobyteHD#QuobyteHD',id=28dd87f8-dfbb-4675-bf36-10c66b9ffff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a574237c6a41be8d2f04f1fe3503ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:11:13Z,use_quota=True,user_id='4701c97580a9411ca1f8a0a1670316e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92478d72-140b-454f-99e8-3c62f96531dc),volume_type_id=92478d72-140b-454f-99e8-3c62f96531dc)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35200f70-26e4-46b9-a555-e542ac649072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35200f70-26e4-46b9-a555-e542ac649072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f131ba9-7955-421b-9be9-b6eea5d83508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f131ba9-7955-421b-9be9-b6eea5d83508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28dd87f8-dfbb-4675-bf36-10c66b9ffff1', 'volume_name': 'volume-28dd87f8-dfbb-4675-bf36-10c66b9ffff1', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08e6dcce-ca7e-4f6f-86fc-2cb44c9e1a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08e6dcce-ca7e-4f6f-86fc-2cb44c9e1a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff10501-72d7-48eb-a6a8-ede035aa7c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:13 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] Volume 28dd87f8-dfbb-4675-bf36-10c66b9ffff1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28dd87f8-dfbb-4675-bf36-10c66b9ffff1', 'volume_size': 1} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=27912e4b-277e-4677-b089-f682d344c427,created_at=2026-07-21T00:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1911764780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=27912e4b-277e-4677-b089-f682d344c427,host='devstack@QuobyteHD#QuobyteHD',id=28dd87f8-dfbb-4675-bf36-10c66b9ffff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a574237c6a41be8d2f04f1fe3503ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:11:13Z,use_quota=True,user_id='4701c97580a9411ca1f8a0a1670316e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92478d72-140b-454f-99e8-3c62f96531dc),volume_type_id=92478d72-140b-454f-99e8-3c62f96531dc)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] Creating volume 28dd87f8-dfbb-4675-bf36-10c66b9ffff1 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:11:13 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-28dd87f8-dfbb-4675-bf36-10c66b9ffff1 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:13 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-251ff59b-e6cd-44c0-bac6-edd854050060 tempest-VolumesActionsTest-474493896 None] Deleted volume successfully. Jul 21 02:11:13 devstack sudo[93389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-28dd87f8-dfbb-4675-bf36-10c66b9ffff1 1073741824 Jul 21 02:11:13 devstack sudo[93389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-251ff59b-e6cd-44c0-bac6-edd854050060 tempest-VolumesActionsTest-474493896 None] Lock "cinder-5fdd2f17-bb65-4b42-b102-2545d04024c5-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] Flow 'volume_create_manager' (35a7939c-e61d-43b8-a3af-f60e39f5390e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1dbedc8-b88e-407b-94bb-6e70230cab01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1dbedc8-b88e-407b-94bb-6e70230cab01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-164527414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45658db2-96df-4f2b-b936-c400281403ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf51711cf25451d866d702be43d9754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:11:14Z,use_quota=True,user_id='5fd7438e660448c58ba7c960765b76e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (551f8e62-b8b7-4736-b482-198378cd715a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (551f8e62-b8b7-4736-b482-198378cd715a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (281c3dec-34fc-462e-96c8-82a80edfe5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (281c3dec-34fc-462e-96c8-82a80edfe5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45658db2-96df-4f2b-b936-c400281403ff', 'volume_name': 'volume-45658db2-96df-4f2b-b936-c400281403ff', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f04cde71-3443-42a6-8d80-174fb7acd297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f04cde71-3443-42a6-8d80-174fb7acd297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf2d9923-d752-4a9d-8093-56ff5b81d5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:13 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] Volume 45658db2-96df-4f2b-b936-c400281403ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45658db2-96df-4f2b-b936-c400281403ff', 'volume_size': 1} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:13 devstack sudo[93389]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-28dd87f8-dfbb-4675-bf36-10c66b9ffff1 1073741824" returned: 0 in 0.440s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-28dd87f8-dfbb-4675-bf36-10c66b9ffff1 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:13 devstack sudo[93395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-28dd87f8-dfbb-4675-bf36-10c66b9ffff1 Jul 21 02:11:13 devstack sudo[93395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:14 devstack sudo[93395]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-28dd87f8-dfbb-4675-bf36-10c66b9ffff1" returned: 0 in 0.249s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:11:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.397s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-164527414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45658db2-96df-4f2b-b936-c400281403ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf51711cf25451d866d702be43d9754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:11:14Z,use_quota=True,user_id='5fd7438e660448c58ba7c960765b76e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:11:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] Creating volume 45658db2-96df-4f2b-b936-c400281403ff {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:11:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:11:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:11:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:11:14 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:11:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-45658db2-96df-4f2b-b936-c400281403ff 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff10501-72d7-48eb-a6a8-ede035aa7c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28dd87f8-dfbb-4675-bf36-10c66b9ffff1', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:14 devstack sudo[93398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-45658db2-96df-4f2b-b936-c400281403ff 1073741824 Jul 21 02:11:14 devstack sudo[93398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db5e10f9-b5b1-4d54-9ce4-28841236866c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:14 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] Volume volume-28dd87f8-dfbb-4675-bf36-10c66b9ffff1 (28dd87f8-dfbb-4675-bf36-10c66b9ffff1): created successfully Jul 21 02:11:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db5e10f9-b5b1-4d54-9ce4-28841236866c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] Flow 'volume_create_manager' (3f784eb0-c138-4fe1-a5df-987f3fffbd4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:11:14 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-0623896f-aec1-45b2-b7ac-b2137683b873 tempest-GroupsTest-563796064 None] Created volume successfully. Jul 21 02:11:14 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-174dd5e1-e4b2-4e03-8e85-60581905433a tempest-GroupsTest-563796064 None] Update group completed successfully. Jul 21 02:11:14 devstack sudo[93398]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-45658db2-96df-4f2b-b936-c400281403ff 1073741824" returned: 0 in 0.569s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-45658db2-96df-4f2b-b936-c400281403ff {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:14 devstack sudo[93410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-45658db2-96df-4f2b-b936-c400281403ff Jul 21 02:11:14 devstack sudo[93410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:14 devstack sudo[93410]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-45658db2-96df-4f2b-b936-c400281403ff" returned: 0 in 0.275s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:11:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf2d9923-d752-4a9d-8093-56ff5b81d5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45658db2-96df-4f2b-b936-c400281403ff', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f37783-f4ed-46e3-ab23-10f557286557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:14 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] Volume volume-45658db2-96df-4f2b-b936-c400281403ff (45658db2-96df-4f2b-b936-c400281403ff): created successfully Jul 21 02:11:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f37783-f4ed-46e3-ab23-10f557286557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] Flow 'volume_create_manager' (35a7939c-e61d-43b8-a3af-f60e39f5390e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:11:15 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-2f2a2afc-cf71-4ceb-9029-841ff65ddc91 tempest-VolumesActionsTest-536708301 None] Created volume successfully. Jul 21 02:11:15 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:11:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] Flow 'volume_create_manager' (8a3fe13f-01be-4f05-b4db-def7d87d0de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:11:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a10974c-817e-4899-af75-1ea8bfaa4a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a10974c-817e-4899-af75-1ea8bfaa4a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-925369252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a11ada44-a926-4c24-b76e-33cbb04e91fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d940d7c2f514f48ae1ed331d1e36db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:11:15Z,use_quota=True,user_id='918e8541ec7742d2b22e778a1643bed9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea6f4b6-a503-45f9-8a9e-2aef4a630cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea6f4b6-a503-45f9-8a9e-2aef4a630cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (487742b4-f598-49cb-a765-cdb70c3da50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (487742b4-f598-49cb-a765-cdb70c3da50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a11ada44-a926-4c24-b76e-33cbb04e91fc', 'volume_name': 'volume-a11ada44-a926-4c24-b76e-33cbb04e91fc', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3409f4f2-b112-4359-9df7-0810590b0520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3409f4f2-b112-4359-9df7-0810590b0520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5854044b-f3c9-4b4e-bb6c-d35601c58aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:15 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] Volume a11ada44-a926-4c24-b76e-33cbb04e91fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a11ada44-a926-4c24-b76e-33cbb04e91fc', 'volume_size': 1} Jul 21 02:11:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-925369252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a11ada44-a926-4c24-b76e-33cbb04e91fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d940d7c2f514f48ae1ed331d1e36db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:11:15Z,use_quota=True,user_id='918e8541ec7742d2b22e778a1643bed9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:11:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] Creating volume a11ada44-a926-4c24-b76e-33cbb04e91fc {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:11:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:11:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:11:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:11:15 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:11:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a11ada44-a926-4c24-b76e-33cbb04e91fc 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:15 devstack sudo[93414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a11ada44-a926-4c24-b76e-33cbb04e91fc 1073741824 Jul 21 02:11:15 devstack sudo[93414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:15 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-ba8b6638-0060-4841-bf80-7a5ea27a19fc req-1fee8679-9c75-4777-b34b-f2aa988dee98 tempest-AttachVolumeNegativeTest-1066125899 None] Terminate volume connection completed successfully. Jul 21 02:11:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-ba8b6638-0060-4841-bf80-7a5ea27a19fc req-1fee8679-9c75-4777-b34b-f2aa988dee98 tempest-AttachVolumeNegativeTest-1066125899 None] Deleting attachment 5412419a-ffe6-4d0e-90cd-d6aa4a261744. {{(pid=87566) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 02:11:15 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3df21258-53dc-456f-b9e5-4811ff44a7f5 tempest-VolumesActionsTest-474493896 None] Acquiring lock "cinder-45658db2-96df-4f2b-b936-c400281403ff-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:11:15 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3df21258-53dc-456f-b9e5-4811ff44a7f5 tempest-VolumesActionsTest-474493896 None] Lock "cinder-45658db2-96df-4f2b-b936-c400281403ff-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:11:16 devstack sudo[93414]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a11ada44-a926-4c24-b76e-33cbb04e91fc 1073741824" returned: 0 in 0.636s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:16 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3df21258-53dc-456f-b9e5-4811ff44a7f5 tempest-VolumesActionsTest-474493896 None] Acquiring lock "cinder-quobyte-45658db2-96df-4f2b-b936-c400281403ff" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:11:16 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3df21258-53dc-456f-b9e5-4811ff44a7f5 tempest-VolumesActionsTest-474493896 None] Lock "cinder-quobyte-45658db2-96df-4f2b-b936-c400281403ff" acquired by "delete_volume" :: waited 0.022s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:11:16 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f31b65a-23a1-4e9f-a1d4-090f2b5aeb04]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:11:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3df21258-53dc-456f-b9e5-4811ff44a7f5 tempest-VolumesActionsTest-474493896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-45658db2-96df-4f2b-b936-c400281403ff {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:16 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-ea570b5b-317f-4f8f-ad3c-76e0f32b08ec tempest-GroupsTest-563796064 None] Update group completed successfully. Jul 21 02:11:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a11ada44-a926-4c24-b76e-33cbb04e91fc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:16 devstack sudo[93425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a11ada44-a926-4c24-b76e-33cbb04e91fc Jul 21 02:11:16 devstack sudo[93425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:16 devstack sudo[93424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-45658db2-96df-4f2b-b936-c400281403ff Jul 21 02:11:16 devstack sudo[93424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:16 devstack sudo[93425]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a11ada44-a926-4c24-b76e-33cbb04e91fc" returned: 0 in 0.262s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:16 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:11:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:16 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5854044b-f3c9-4b4e-bb6c-d35601c58aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a11ada44-a926-4c24-b76e-33cbb04e91fc', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:16 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d973619-d016-4eac-8a68-6ba3e3657476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:16 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] Volume volume-a11ada44-a926-4c24-b76e-33cbb04e91fc (a11ada44-a926-4c24-b76e-33cbb04e91fc): created successfully Jul 21 02:11:16 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d973619-d016-4eac-8a68-6ba3e3657476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:16 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] Flow 'volume_create_manager' (8a3fe13f-01be-4f05-b4db-def7d87d0de0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:11:16 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-6d626366-424c-4763-b80f-4e865c4d0c3e tempest-AttachVolumeTestJSON-77441230 None] Created volume successfully. Jul 21 02:11:16 devstack sudo[93424]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3df21258-53dc-456f-b9e5-4811ff44a7f5 tempest-VolumesActionsTest-474493896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-45658db2-96df-4f2b-b936-c400281403ff" returned: 0 in 0.383s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3df21258-53dc-456f-b9e5-4811ff44a7f5 tempest-VolumesActionsTest-474493896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-45658db2-96df-4f2b-b936-c400281403ff {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:16 devstack sudo[93433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-45658db2-96df-4f2b-b936-c400281403ff Jul 21 02:11:16 devstack sudo[93433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:16 devstack sudo[93433]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3df21258-53dc-456f-b9e5-4811ff44a7f5 tempest-VolumesActionsTest-474493896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-45658db2-96df-4f2b-b936-c400281403ff" returned: 0 in 0.310s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:16 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3df21258-53dc-456f-b9e5-4811ff44a7f5 tempest-VolumesActionsTest-474493896 None] Lock "cinder-quobyte-45658db2-96df-4f2b-b936-c400281403ff" released by "delete_volume" :: held 0.735s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:11:16 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-3df21258-53dc-456f-b9e5-4811ff44a7f5 tempest-VolumesActionsTest-474493896 None] Created reservations ['6470e137-60db-4794-bd4f-31712d8d6e65', '0a7b44eb-b458-4695-a483-fb2def3c7bbd', 'd45a973c-8154-4b51-bb28-0f1c46e066f0', 'e182047f-790f-493e-ad2e-530e1f45b12f'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:11:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3df21258-53dc-456f-b9e5-4811ff44a7f5 tempest-VolumesActionsTest-474493896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3df21258-53dc-456f-b9e5-4811ff44a7f5 tempest-VolumesActionsTest-474493896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:16 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-3df21258-53dc-456f-b9e5-4811ff44a7f5 tempest-VolumesActionsTest-474493896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:11:16 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-3df21258-53dc-456f-b9e5-4811ff44a7f5 tempest-VolumesActionsTest-474493896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:11:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3df21258-53dc-456f-b9e5-4811ff44a7f5 tempest-VolumesActionsTest-474493896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3df21258-53dc-456f-b9e5-4811ff44a7f5 tempest-VolumesActionsTest-474493896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:17 devstack sudo[93445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:11:17 devstack sudo[93445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:17 devstack sudo[93445]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3df21258-53dc-456f-b9e5-4811ff44a7f5 tempest-VolumesActionsTest-474493896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.393s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:17 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-3df21258-53dc-456f-b9e5-4811ff44a7f5 tempest-VolumesActionsTest-474493896 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:11:17 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-3df21258-53dc-456f-b9e5-4811ff44a7f5 tempest-VolumesActionsTest-474493896 None] Deleted volume successfully. Jul 21 02:11:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3df21258-53dc-456f-b9e5-4811ff44a7f5 tempest-VolumesActionsTest-474493896 None] Lock "cinder-45658db2-96df-4f2b-b936-c400281403ff-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:11:18 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:11:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] Flow 'volume_create_manager' (d2e6abe5-66cd-4162-8c17-30025ab1f869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:11:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e94a85c-ae66-47bb-a891-fb0c47949477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e94a85c-ae66-47bb-a891-fb0c47949477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-705727628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d739a76-31d1-422f-9264-69f5758457c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf51711cf25451d866d702be43d9754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:11:18Z,use_quota=True,user_id='5fd7438e660448c58ba7c960765b76e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bf578ed-f65f-4f98-bc1e-d08dd107ac2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bf578ed-f65f-4f98-bc1e-d08dd107ac2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c7b219-7793-45e0-aace-db99fe5b8724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c7b219-7793-45e0-aace-db99fe5b8724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d739a76-31d1-422f-9264-69f5758457c9', 'volume_name': 'volume-6d739a76-31d1-422f-9264-69f5758457c9', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73833893-3d11-4931-a378-adbac75c5700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73833893-3d11-4931-a378-adbac75c5700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707f25d7-3115-4eb5-a6be-29ca67282cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:18 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] Volume 6d739a76-31d1-422f-9264-69f5758457c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d739a76-31d1-422f-9264-69f5758457c9', 'volume_size': 1} Jul 21 02:11:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-705727628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d739a76-31d1-422f-9264-69f5758457c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf51711cf25451d866d702be43d9754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:11:18Z,use_quota=True,user_id='5fd7438e660448c58ba7c960765b76e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:11:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] Creating volume 6d739a76-31d1-422f-9264-69f5758457c9 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:11:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:11:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:11:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:11:18 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:11:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6d739a76-31d1-422f-9264-69f5758457c9 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:18 devstack sudo[93467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6d739a76-31d1-422f-9264-69f5758457c9 1073741824 Jul 21 02:11:18 devstack sudo[93467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3dce7076-3cdd-4e42-883b-1762593b302b tempest-GroupsTest-563796064 None] Acquiring lock "cinder-quobyte-28dd87f8-dfbb-4675-bf36-10c66b9ffff1" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:11:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3dce7076-3cdd-4e42-883b-1762593b302b tempest-GroupsTest-563796064 None] Lock "cinder-quobyte-28dd87f8-dfbb-4675-bf36-10c66b9ffff1" acquired by "delete_volume" :: waited 0.035s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:11:18 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[4272db59-9afd-483d-b72a-cf1975a582d1]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:11:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3dce7076-3cdd-4e42-883b-1762593b302b tempest-GroupsTest-563796064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-28dd87f8-dfbb-4675-bf36-10c66b9ffff1 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:18 devstack sudo[93470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-28dd87f8-dfbb-4675-bf36-10c66b9ffff1 Jul 21 02:11:18 devstack sudo[93470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:18 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=129,cinder:INSERT=34,cinder:UPDATE=132,cinder:DELETE=6 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:11:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-2424991b-6512-4c2b-83c1-5732934df470 req-26cced0e-f386-407d-a8de-74d7bda58a8e tempest-AttachVolumeTestJSON-77441230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:18 devstack sudo[93467]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6d739a76-31d1-422f-9264-69f5758457c9 1073741824" returned: 0 in 0.718s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:18 devstack sudo[93470]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3dce7076-3cdd-4e42-883b-1762593b302b tempest-GroupsTest-563796064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-28dd87f8-dfbb-4675-bf36-10c66b9ffff1" returned: 0 in 0.576s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3dce7076-3cdd-4e42-883b-1762593b302b tempest-GroupsTest-563796064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-28dd87f8-dfbb-4675-bf36-10c66b9ffff1 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6d739a76-31d1-422f-9264-69f5758457c9 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:19 devstack sudo[93488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-28dd87f8-dfbb-4675-bf36-10c66b9ffff1 Jul 21 02:11:19 devstack sudo[93488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:19 devstack sudo[93489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6d739a76-31d1-422f-9264-69f5758457c9 Jul 21 02:11:19 devstack sudo[93489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:19 devstack sudo[93488]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3dce7076-3cdd-4e42-883b-1762593b302b tempest-GroupsTest-563796064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-28dd87f8-dfbb-4675-bf36-10c66b9ffff1" returned: 0 in 0.273s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:19 devstack sudo[93489]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:19 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3dce7076-3cdd-4e42-883b-1762593b302b tempest-GroupsTest-563796064 None] Lock "cinder-quobyte-28dd87f8-dfbb-4675-bf36-10c66b9ffff1" released by "delete_volume" :: held 0.922s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:11:19 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3dce7076-3cdd-4e42-883b-1762593b302b tempest-GroupsTest-563796064 None] Acquiring lock "cinder-quobyte-c13c301d-3abc-444f-ad93-4d279e6af32d" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:11:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6d739a76-31d1-422f-9264-69f5758457c9" returned: 0 in 0.280s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:19 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:11:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-2424991b-6512-4c2b-83c1-5732934df470 req-26cced0e-f386-407d-a8de-74d7bda58a8e tempest-AttachVolumeTestJSON-77441230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.491s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707f25d7-3115-4eb5-a6be-29ca67282cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d739a76-31d1-422f-9264-69f5758457c9', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b26b0cd2-0b39-4c7a-bcbf-9e8dcdca89c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:19 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3dce7076-3cdd-4e42-883b-1762593b302b tempest-GroupsTest-563796064 None] Lock "cinder-quobyte-c13c301d-3abc-444f-ad93-4d279e6af32d" acquired by "delete_volume" :: waited 0.043s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:11:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-2424991b-6512-4c2b-83c1-5732934df470 req-26cced0e-f386-407d-a8de-74d7bda58a8e tempest-AttachVolumeTestJSON-77441230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.050s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:19 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63dd2d2-1194-4552-bb22-aab354b1c5b4]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:11:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3dce7076-3cdd-4e42-883b-1762593b302b tempest-GroupsTest-563796064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c13c301d-3abc-444f-ad93-4d279e6af32d {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:19 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] Volume volume-6d739a76-31d1-422f-9264-69f5758457c9 (6d739a76-31d1-422f-9264-69f5758457c9): created successfully Jul 21 02:11:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b26b0cd2-0b39-4c7a-bcbf-9e8dcdca89c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] Flow 'volume_create_manager' (d2e6abe5-66cd-4162-8c17-30025ab1f869) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:11:19 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-459326bf-5586-43b2-b807-7440b4e3f3bf tempest-VolumesActionsTest-536708301 None] Created volume successfully. Jul 21 02:11:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-2424991b-6512-4c2b-83c1-5732934df470 req-26cced0e-f386-407d-a8de-74d7bda58a8e tempest-AttachVolumeTestJSON-77441230 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea', 'name': 'volume-a11ada44-a926-4c24-b76e-33cbb04e91fc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd27b0093-ea89-46e7-96d1-202881b25e56', 'enforce_multipath': True} {{(pid=87566) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 02:11:19 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-2424991b-6512-4c2b-83c1-5732934df470 req-26cced0e-f386-407d-a8de-74d7bda58a8e tempest-AttachVolumeTestJSON-77441230 None] attachment_update completed successfully. Jul 21 02:11:19 devstack sudo[93494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c13c301d-3abc-444f-ad93-4d279e6af32d Jul 21 02:11:19 devstack sudo[93494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:19 devstack sudo[93494]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3dce7076-3cdd-4e42-883b-1762593b302b tempest-GroupsTest-563796064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c13c301d-3abc-444f-ad93-4d279e6af32d" returned: 0 in 0.507s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3dce7076-3cdd-4e42-883b-1762593b302b tempest-GroupsTest-563796064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c13c301d-3abc-444f-ad93-4d279e6af32d {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:19 devstack sudo[93770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c13c301d-3abc-444f-ad93-4d279e6af32d Jul 21 02:11:19 devstack sudo[93770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:20 devstack sudo[93770]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3dce7076-3cdd-4e42-883b-1762593b302b tempest-GroupsTest-563796064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c13c301d-3abc-444f-ad93-4d279e6af32d" returned: 0 in 0.401s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3dce7076-3cdd-4e42-883b-1762593b302b tempest-GroupsTest-563796064 None] Lock "cinder-quobyte-c13c301d-3abc-444f-ad93-4d279e6af32d" released by "delete_volume" :: held 0.965s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:11:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8a8b0e4b-2de1-49f5-a752-f6957c06b563 tempest-VolumesActionsTest-474493896 None] Acquiring lock "cinder-6d739a76-31d1-422f-9264-69f5758457c9-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:11:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8a8b0e4b-2de1-49f5-a752-f6957c06b563 tempest-VolumesActionsTest-474493896 None] Lock "cinder-6d739a76-31d1-422f-9264-69f5758457c9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:11:20 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-3dce7076-3cdd-4e42-883b-1762593b302b tempest-GroupsTest-563796064 None] Created reservations ['504fb333-2e9d-4629-b219-834cbbeb2670'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:11:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8a8b0e4b-2de1-49f5-a752-f6957c06b563 tempest-VolumesActionsTest-474493896 None] Acquiring lock "cinder-quobyte-6d739a76-31d1-422f-9264-69f5758457c9" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:11:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8a8b0e4b-2de1-49f5-a752-f6957c06b563 tempest-VolumesActionsTest-474493896 None] Lock "cinder-quobyte-6d739a76-31d1-422f-9264-69f5758457c9" acquired by "delete_volume" :: waited 0.023s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:11:20 devstack cinder-volume[87566]: WARNING cinder.quota [None req-3dce7076-3cdd-4e42-883b-1762593b302b tempest-GroupsTest-563796064 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-517536147 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-517536147, it is now deprecated. Please use the default quota class for default quota. Jul 21 02:11:20 devstack cinder-volume[87566]: WARNING cinder.quota [None req-3dce7076-3cdd-4e42-883b-1762593b302b tempest-GroupsTest-563796064 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-517536147 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-517536147, it is now deprecated. Please use the default quota class for default quota. Jul 21 02:11:20 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ffdc10-a863-4dbf-a555-b8c6ed1c3f6f]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:11:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8a8b0e4b-2de1-49f5-a752-f6957c06b563 tempest-VolumesActionsTest-474493896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6d739a76-31d1-422f-9264-69f5758457c9 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:20 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-3dce7076-3cdd-4e42-883b-1762593b302b tempest-GroupsTest-563796064 None] Created reservations ['11c262e5-a036-4d1f-ac48-6c4356797ae6', '679a7a48-a1d2-4dc9-9644-be207ef01b4c', 'd4923695-e6a1-4ba8-8557-5005a557ac3c', 'c7ddc006-890c-43fa-b48c-6e36485d158a'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:11:20 devstack sudo[93885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6d739a76-31d1-422f-9264-69f5758457c9 Jul 21 02:11:20 devstack sudo[93885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:20 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-3dce7076-3cdd-4e42-883b-1762593b302b tempest-GroupsTest-563796064 None] Created reservations ['88766e11-488e-4a2b-80fd-a4e2c6df2f58', '3d58794d-df0c-459e-ad03-8cf32398c48f', '132d2485-dbad-4a57-8b1b-44d2de057b5c', '4307ee12-050e-4652-9d17-4b411bd7f5d0'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:11:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3dce7076-3cdd-4e42-883b-1762593b302b tempest-GroupsTest-563796064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3dce7076-3cdd-4e42-883b-1762593b302b tempest-GroupsTest-563796064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:20 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-3dce7076-3cdd-4e42-883b-1762593b302b tempest-GroupsTest-563796064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:11:20 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-3dce7076-3cdd-4e42-883b-1762593b302b tempest-GroupsTest-563796064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:11:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3dce7076-3cdd-4e42-883b-1762593b302b tempest-GroupsTest-563796064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3dce7076-3cdd-4e42-883b-1762593b302b tempest-GroupsTest-563796064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:20 devstack sudo[93890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:11:20 devstack sudo[93890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:21 devstack sudo[93885]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8a8b0e4b-2de1-49f5-a752-f6957c06b563 tempest-VolumesActionsTest-474493896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6d739a76-31d1-422f-9264-69f5758457c9" returned: 0 in 0.583s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8a8b0e4b-2de1-49f5-a752-f6957c06b563 tempest-VolumesActionsTest-474493896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6d739a76-31d1-422f-9264-69f5758457c9 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:21 devstack sudo[93893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6d739a76-31d1-422f-9264-69f5758457c9 Jul 21 02:11:21 devstack sudo[93893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:21 devstack sudo[93890]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3dce7076-3cdd-4e42-883b-1762593b302b tempest-GroupsTest-563796064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.333s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:21 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-3dce7076-3cdd-4e42-883b-1762593b302b tempest-GroupsTest-563796064 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:11:21 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-3dce7076-3cdd-4e42-883b-1762593b302b tempest-GroupsTest-563796064 None] Delete group completed successfully. Jul 21 02:11:21 devstack sudo[93893]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8a8b0e4b-2de1-49f5-a752-f6957c06b563 tempest-VolumesActionsTest-474493896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6d739a76-31d1-422f-9264-69f5758457c9" returned: 0 in 0.312s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:21 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8a8b0e4b-2de1-49f5-a752-f6957c06b563 tempest-VolumesActionsTest-474493896 None] Lock "cinder-quobyte-6d739a76-31d1-422f-9264-69f5758457c9" released by "delete_volume" :: held 0.951s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:11:21 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-8a8b0e4b-2de1-49f5-a752-f6957c06b563 tempest-VolumesActionsTest-474493896 None] Created reservations ['aa4a4977-3fdd-4025-aaad-849cf64b7f12', '44dc621b-3262-4692-842d-455c3427b0f2', 'ecb1cc2b-939f-4859-adb7-962e5b5015c1', '65776372-2b89-4296-8f38-db1943c6b60e'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:11:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8a8b0e4b-2de1-49f5-a752-f6957c06b563 tempest-VolumesActionsTest-474493896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8a8b0e4b-2de1-49f5-a752-f6957c06b563 tempest-VolumesActionsTest-474493896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:21 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8a8b0e4b-2de1-49f5-a752-f6957c06b563 tempest-VolumesActionsTest-474493896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:11:21 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8a8b0e4b-2de1-49f5-a752-f6957c06b563 tempest-VolumesActionsTest-474493896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:11:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8a8b0e4b-2de1-49f5-a752-f6957c06b563 tempest-VolumesActionsTest-474493896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8a8b0e4b-2de1-49f5-a752-f6957c06b563 tempest-VolumesActionsTest-474493896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:21 devstack sudo[93902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:11:21 devstack sudo[93902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:21 devstack sudo[93902]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8a8b0e4b-2de1-49f5-a752-f6957c06b563 tempest-VolumesActionsTest-474493896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.259s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:21 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-8a8b0e4b-2de1-49f5-a752-f6957c06b563 tempest-VolumesActionsTest-474493896 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:11:21 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-8a8b0e4b-2de1-49f5-a752-f6957c06b563 tempest-VolumesActionsTest-474493896 None] Deleted volume successfully. Jul 21 02:11:21 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8a8b0e4b-2de1-49f5-a752-f6957c06b563 tempest-VolumesActionsTest-474493896 None] Lock "cinder-6d739a76-31d1-422f-9264-69f5758457c9-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:11:23 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:11:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] Flow 'volume_create_manager' (32ce5f4e-ad39-44be-a6bc-7301415acf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:11:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ded585-9bf2-4b83-af04-11ac82150e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ded585-9bf2-4b83-af04-11ac82150e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-94284220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7196138-a707-4701-9040-80550af20bf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf51711cf25451d866d702be43d9754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:11:23Z,use_quota=True,user_id='5fd7438e660448c58ba7c960765b76e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47826c21-7723-4e50-a99a-1bc2e11e41de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47826c21-7723-4e50-a99a-1bc2e11e41de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2634e1e-b5e3-4598-8e53-ddeb5479886c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2634e1e-b5e3-4598-8e53-ddeb5479886c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7196138-a707-4701-9040-80550af20bf9', 'volume_name': 'volume-f7196138-a707-4701-9040-80550af20bf9', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d3cd91-1356-4c70-b82b-042072794edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d3cd91-1356-4c70-b82b-042072794edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (995c7ec5-7ae5-4640-88a6-98e2b10d9f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:23 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] Volume f7196138-a707-4701-9040-80550af20bf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7196138-a707-4701-9040-80550af20bf9', 'volume_size': 1} Jul 21 02:11:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:23 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-94284220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7196138-a707-4701-9040-80550af20bf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf51711cf25451d866d702be43d9754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:11:23Z,use_quota=True,user_id='5fd7438e660448c58ba7c960765b76e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:11:23 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] Creating volume f7196138-a707-4701-9040-80550af20bf9 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:11:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:23 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:11:23 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:11:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:23 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:11:23 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:11:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f7196138-a707-4701-9040-80550af20bf9 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:23 devstack sudo[93907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f7196138-a707-4701-9040-80550af20bf9 1073741824 Jul 21 02:11:23 devstack sudo[93907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:24 devstack sudo[93907]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f7196138-a707-4701-9040-80550af20bf9 1073741824" returned: 0 in 0.524s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f7196138-a707-4701-9040-80550af20bf9 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:24 devstack sudo[93913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f7196138-a707-4701-9040-80550af20bf9 Jul 21 02:11:24 devstack sudo[93913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:24 devstack sudo[93913]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f7196138-a707-4701-9040-80550af20bf9" returned: 0 in 0.470s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:24 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:11:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:24 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (995c7ec5-7ae5-4640-88a6-98e2b10d9f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7196138-a707-4701-9040-80550af20bf9', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:24 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd856b9b-a1e2-4cac-b56c-f2d4f4d1893d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:24 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] Volume volume-f7196138-a707-4701-9040-80550af20bf9 (f7196138-a707-4701-9040-80550af20bf9): created successfully Jul 21 02:11:24 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd856b9b-a1e2-4cac-b56c-f2d4f4d1893d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:24 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] Flow 'volume_create_manager' (32ce5f4e-ad39-44be-a6bc-7301415acf7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:11:24 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-807416cf-592e-4538-bc5d-4ae1bd197eaf tempest-VolumesActionsTest-536708301 None] Created volume successfully. Jul 21 02:11:26 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8c063fc6-47c3-4fda-a1b3-bd938d2eda86 tempest-VolumesActionsTest-536708301 None] Acquiring lock "cinder-f7196138-a707-4701-9040-80550af20bf9-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:11:26 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8c063fc6-47c3-4fda-a1b3-bd938d2eda86 tempest-VolumesActionsTest-536708301 None] Lock "cinder-f7196138-a707-4701-9040-80550af20bf9-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:11:26 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8c063fc6-47c3-4fda-a1b3-bd938d2eda86 tempest-VolumesActionsTest-536708301 None] Acquiring lock "cinder-quobyte-f7196138-a707-4701-9040-80550af20bf9" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:11:26 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8c063fc6-47c3-4fda-a1b3-bd938d2eda86 tempest-VolumesActionsTest-536708301 None] Lock "cinder-quobyte-f7196138-a707-4701-9040-80550af20bf9" acquired by "delete_volume" :: waited 0.035s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:11:26 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[664d08a6-afcf-4b9a-83f3-9d33cce59571]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:11:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8c063fc6-47c3-4fda-a1b3-bd938d2eda86 tempest-VolumesActionsTest-536708301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f7196138-a707-4701-9040-80550af20bf9 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:27 devstack sudo[94416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f7196138-a707-4701-9040-80550af20bf9 Jul 21 02:11:27 devstack sudo[94416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:27 devstack sudo[94416]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8c063fc6-47c3-4fda-a1b3-bd938d2eda86 tempest-VolumesActionsTest-536708301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f7196138-a707-4701-9040-80550af20bf9" returned: 0 in 0.732s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8c063fc6-47c3-4fda-a1b3-bd938d2eda86 tempest-VolumesActionsTest-536708301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f7196138-a707-4701-9040-80550af20bf9 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:27 devstack sudo[94427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f7196138-a707-4701-9040-80550af20bf9 Jul 21 02:11:27 devstack sudo[94427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:28 devstack sudo[94427]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8c063fc6-47c3-4fda-a1b3-bd938d2eda86 tempest-VolumesActionsTest-536708301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f7196138-a707-4701-9040-80550af20bf9" returned: 0 in 0.449s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:28 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8c063fc6-47c3-4fda-a1b3-bd938d2eda86 tempest-VolumesActionsTest-536708301 None] Lock "cinder-quobyte-f7196138-a707-4701-9040-80550af20bf9" released by "delete_volume" :: held 1.281s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:11:28 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-8c063fc6-47c3-4fda-a1b3-bd938d2eda86 tempest-VolumesActionsTest-536708301 None] Created reservations ['f0830a1d-d382-4195-8611-f3080a50cf9f', 'd464e6c0-75a6-44a7-a98c-bd9a9c5a073d', '4aeeebf6-4fbf-421c-9be9-b0b54683dc5b', 'e5110267-a643-4db3-baf9-ccf3ad9dbb30'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:11:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8c063fc6-47c3-4fda-a1b3-bd938d2eda86 tempest-VolumesActionsTest-536708301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8c063fc6-47c3-4fda-a1b3-bd938d2eda86 tempest-VolumesActionsTest-536708301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:28 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8c063fc6-47c3-4fda-a1b3-bd938d2eda86 tempest-VolumesActionsTest-536708301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:11:28 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8c063fc6-47c3-4fda-a1b3-bd938d2eda86 tempest-VolumesActionsTest-536708301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:11:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8c063fc6-47c3-4fda-a1b3-bd938d2eda86 tempest-VolumesActionsTest-536708301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8c063fc6-47c3-4fda-a1b3-bd938d2eda86 tempest-VolumesActionsTest-536708301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:28 devstack sudo[94432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:11:28 devstack sudo[94432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:28 devstack sudo[94432]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8c063fc6-47c3-4fda-a1b3-bd938d2eda86 tempest-VolumesActionsTest-536708301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.541s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:28 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-8c063fc6-47c3-4fda-a1b3-bd938d2eda86 tempest-VolumesActionsTest-536708301 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:11:28 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-8c063fc6-47c3-4fda-a1b3-bd938d2eda86 tempest-VolumesActionsTest-536708301 None] Deleted volume successfully. Jul 21 02:11:28 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8c063fc6-47c3-4fda-a1b3-bd938d2eda86 tempest-VolumesActionsTest-536708301 None] Lock "cinder-f7196138-a707-4701-9040-80550af20bf9-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:11:30 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-5f66e631-4d24-4f59-8189-5e4640cee94b tempest-GroupsV314Test-1940193562 None] Group tempest-GroupsV314Test-Group-507783525: creating Jul 21 02:11:30 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-5f66e631-4d24-4f59-8189-5e4640cee94b tempest-GroupsV314Test-1940193562 None] Group tempest-GroupsV314Test-Group-507783525: created successfully Jul 21 02:11:30 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-5f66e631-4d24-4f59-8189-5e4640cee94b tempest-GroupsV314Test-1940193562 None] Create group completed successfully. Jul 21 02:11:32 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:11:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] Flow 'volume_create_manager' (22d30acc-33c8-4014-8ca5-13fc3e618ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:11:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5f0382-5a4d-4187-83ca-a6005f2f165b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5f0382-5a4d-4187-83ca-a6005f2f165b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1201055960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f0190e4e-69fb-48ff-aae3-7ca7aab0af74,host='devstack@QuobyteHD#QuobyteHD',id=667caadf-204f-4df8-802e-920d76ee9818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f1a43a101954ef8a308e2676bac1ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:11:33Z,use_quota=True,user_id='c308efc97f074ee59625a95f7f25592b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54ac0b52-2faf-4f65-92f4-de3ef9368a07),volume_type_id=54ac0b52-2faf-4f65-92f4-de3ef9368a07)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef98b05-31f2-4356-855d-4406ab338850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef98b05-31f2-4356-855d-4406ab338850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f92c5c07-c08d-4b45-8c97-37b7a75fef52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f92c5c07-c08d-4b45-8c97-37b7a75fef52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '667caadf-204f-4df8-802e-920d76ee9818', 'volume_name': 'volume-667caadf-204f-4df8-802e-920d76ee9818', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79866d43-b30c-4354-8ea9-08f4f1e18b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79866d43-b30c-4354-8ea9-08f4f1e18b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd90253b-0616-4309-a99f-eda62b21bfcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:32 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] Volume 667caadf-204f-4df8-802e-920d76ee9818: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-667caadf-204f-4df8-802e-920d76ee9818', 'volume_size': 1} Jul 21 02:11:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:32 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f0190e4e-69fb-48ff-aae3-7ca7aab0af74,created_at=2026-07-21T00:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1201055960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f0190e4e-69fb-48ff-aae3-7ca7aab0af74,host='devstack@QuobyteHD#QuobyteHD',id=667caadf-204f-4df8-802e-920d76ee9818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f1a43a101954ef8a308e2676bac1ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:11:33Z,use_quota=True,user_id='c308efc97f074ee59625a95f7f25592b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54ac0b52-2faf-4f65-92f4-de3ef9368a07),volume_type_id=54ac0b52-2faf-4f65-92f4-de3ef9368a07)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:11:32 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] Creating volume 667caadf-204f-4df8-802e-920d76ee9818 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:11:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:32 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:11:32 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:11:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:32 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:11:32 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:11:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:33 devstack sudo[94510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818 1073741824 Jul 21 02:11:33 devstack sudo[94510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:33 devstack sudo[94510]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818 1073741824" returned: 0 in 1.023s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:34 devstack sudo[94527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818 Jul 21 02:11:34 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:34 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818" returned: 0 in 0.713s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:11:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.885s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd90253b-0616-4309-a99f-eda62b21bfcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-667caadf-204f-4df8-802e-920d76ee9818', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b913b354-5801-4be6-b864-701b71a153e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:35 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] Volume volume-667caadf-204f-4df8-802e-920d76ee9818 (667caadf-204f-4df8-802e-920d76ee9818): created successfully Jul 21 02:11:35 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b913b354-5801-4be6-b864-701b71a153e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:35 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] Flow 'volume_create_manager' (22d30acc-33c8-4014-8ca5-13fc3e618ae0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:11:35 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-6314b6d1-cd03-4c3d-b655-687c33042336 tempest-GroupsV314Test-1940193562 None] Created volume successfully. Jul 21 02:11:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:36 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Cloning volume 667caadf-204f-4df8-802e-920d76ee9818 to volume b17bb689-c59f-4155-99ed-26f3ef6e9089 Jul 21 02:11:36 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Creating offline snapshot 159abc9d-25e7-4f24-94db-77fd2c0d7e5a of volume 667caadf-204f-4df8-802e-920d76ee9818 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:11:36 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f7df5f-a88a-4d97-8e3e-9732bff41eb0]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:11:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:36 devstack sudo[94534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818 Jul 21 02:11:36 devstack sudo[94534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:36 devstack sudo[94534]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818" returned: 0 in 0.527s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818.159abc9d-25e7-4f24-94db-77fd2c0d7e5a 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:36 devstack sudo[94540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818.159abc9d-25e7-4f24-94db-77fd2c0d7e5a 1G Jul 21 02:11:36 devstack sudo[94540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:37 devstack sudo[94540]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818.159abc9d-25e7-4f24-94db-77fd2c0d7e5a 1G" returned: 0 in 0.779s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-667caadf-204f-4df8-802e-920d76ee9818 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818.159abc9d-25e7-4f24-94db-77fd2c0d7e5a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:37 devstack sudo[94546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-667caadf-204f-4df8-802e-920d76ee9818 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818.159abc9d-25e7-4f24-94db-77fd2c0d7e5a Jul 21 02:11:37 devstack sudo[94546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:38 devstack sudo[94546]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-667caadf-204f-4df8-802e-920d76ee9818 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818.159abc9d-25e7-4f24-94db-77fd2c0d7e5a" returned: 0 in 0.643s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:38 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818.159abc9d-25e7-4f24-94db-77fd2c0d7e5a is being set with open permissions: ugo+rw: NotImplementedError Jul 21 02:11:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818.159abc9d-25e7-4f24-94db-77fd2c0d7e5a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:38 devstack sudo[94551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818.159abc9d-25e7-4f24-94db-77fd2c0d7e5a Jul 21 02:11:38 devstack sudo[94551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:38 devstack sudo[94551]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818.159abc9d-25e7-4f24-94db-77fd2c0d7e5a" returned: 0 in 0.614s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:38 devstack sudo[94554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818.info Jul 21 02:11:38 devstack sudo[94554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:39 devstack sudo[94554]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818.info" returned: 0 in 0.841s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:39 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 02:11:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:39 devstack sudo[94560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818.info Jul 21 02:11:39 devstack sudo[94560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:40 devstack sudo[94560]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818.info" returned: 0 in 0.417s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:40 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Acquiring lock "cinder-quobyte-b17bb689-c59f-4155-99ed-26f3ef6e9089" by "_copy_volume_from_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:11:40 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Lock "cinder-quobyte-b17bb689-c59f-4155-99ed-26f3ef6e9089" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:11:40 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] snapshot: 159abc9d-25e7-4f24-94db-77fd2c0d7e5a, volume: b17bb689-c59f-4155-99ed-26f3ef6e9089, {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 02:11:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:40 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:11:40 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:11:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:40 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[723b18d1-5b7d-4f3f-bacb-c43bd63521f1]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:11:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818.159abc9d-25e7-4f24-94db-77fd2c0d7e5a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:40 devstack sudo[94563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818.159abc9d-25e7-4f24-94db-77fd2c0d7e5a Jul 21 02:11:40 devstack sudo[94563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:40 devstack sudo[94563]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818.159abc9d-25e7-4f24-94db-77fd2c0d7e5a" returned: 0 in 0.770s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:40 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-667caadf-204f-4df8-802e-920d76ee9818(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:11:40 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818 {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 02:11:40 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Creating direct copy from snapshot {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 02:11:40 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d30543-9eca-44e0-9bdf-a0cfa9af9ac0]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:11:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:41 devstack sudo[94568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818 Jul 21 02:11:41 devstack sudo[94568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:41 devstack sudo[94568]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818" returned: 0 in 0.697s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:41 devstack cinder-volume[87566]: DEBUG cinder.utils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Path /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b17bb689-c59f-4155-99ed-26f3ef6e9089 not found in is_blk_device check {{(pid=87566) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 02:11:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b17bb689-c59f-4155-99ed-26f3ef6e9089 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:41 devstack sudo[94588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b17bb689-c59f-4155-99ed-26f3ef6e9089 Jul 21 02:11:41 devstack sudo[94588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:48 devstack sudo[94588]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b17bb689-c59f-4155-99ed-26f3ef6e9089" returned: 0 in 6.643s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:48 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b6c1ea-2e7b-4736-9f72-e45505c8199d]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:11:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:48 devstack sudo[94663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818 Jul 21 02:11:48 devstack sudo[94663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:48 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=107,cinder:INSERT=24,cinder:UPDATE=132,cinder:DELETE=8 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:11:48 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:UPDATE=38,cinder:SELECT=37,cinder:DELETE=3,cinder:INSERT=13 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:11:48 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:11:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:11:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:11:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:48 devstack sudo[94682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:11:48 devstack sudo[94682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:49 devstack sudo[94682]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.313s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:49 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:11:49 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager._thread_info {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:11:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread count: 8 {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 02:11:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread info: [<_MainThread(MainThread, started 135786703114368)>, , , , , , , ] {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 02:11:49 devstack sudo[94663]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818" returned: 0 in 0.940s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:49 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Image conversion details: src /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818, size 1024.00 MB, duration 6.64 sec, destination /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b17bb689-c59f-4155-99ed-26f3ef6e9089 {{(pid=87566) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 02:11:49 devstack cinder-volume[87566]: INFO cinder.image.image_utils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Converted 1024.00 MB image at 154.11 MB/s Jul 21 02:11:49 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b17bb689-c59f-4155-99ed-26f3ef6e9089 is being set with open permissions: ugo+rw: NotImplementedError Jul 21 02:11:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b17bb689-c59f-4155-99ed-26f3ef6e9089 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:49 devstack sudo[94688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b17bb689-c59f-4155-99ed-26f3ef6e9089 Jul 21 02:11:49 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:49 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b17bb689-c59f-4155-99ed-26f3ef6e9089" returned: 0 in 0.321s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:49 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Lock "cinder-quobyte-b17bb689-c59f-4155-99ed-26f3ef6e9089" released by "_copy_volume_from_snapshot" :: held 9.537s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:11:49 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Acquiring lock "cinder-quobyte-159abc9d-25e7-4f24-94db-77fd2c0d7e5a" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:11:49 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Lock "cinder-quobyte-159abc9d-25e7-4f24-94db-77fd2c0d7e5a" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:11:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Deleting offline snapshot 159abc9d-25e7-4f24-94db-77fd2c0d7e5a of volume 667caadf-204f-4df8-802e-920d76ee9818 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:11:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] snapshot_file for this snap is: volume-667caadf-204f-4df8-802e-920d76ee9818.159abc9d-25e7-4f24-94db-77fd2c0d7e5a {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:11:49 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[37089120-8275-4fdf-8373-aa85c4c443ba]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:11:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818.159abc9d-25e7-4f24-94db-77fd2c0d7e5a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:49 devstack sudo[94691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818.159abc9d-25e7-4f24-94db-77fd2c0d7e5a Jul 21 02:11:49 devstack sudo[94691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:50 devstack sudo[94691]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818.159abc9d-25e7-4f24-94db-77fd2c0d7e5a" returned: 0 in 0.415s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-667caadf-204f-4df8-802e-920d76ee9818(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:11:50 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[338b52e5-926f-4f39-a90e-4ad8b8884455]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:11:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:50 devstack sudo[94696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818 Jul 21 02:11:50 devstack sudo[94696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:50 devstack sudo[94696]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818" returned: 0 in 0.410s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818.159abc9d-25e7-4f24-94db-77fd2c0d7e5a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:50 devstack sudo[94705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818.159abc9d-25e7-4f24-94db-77fd2c0d7e5a Jul 21 02:11:50 devstack sudo[94705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:51 devstack sudo[94705]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818.159abc9d-25e7-4f24-94db-77fd2c0d7e5a" returned: 0 in 0.471s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818.159abc9d-25e7-4f24-94db-77fd2c0d7e5a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:51 devstack sudo[94712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818.159abc9d-25e7-4f24-94db-77fd2c0d7e5a Jul 21 02:11:51 devstack sudo[94712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:51 devstack sudo[94712]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818.159abc9d-25e7-4f24-94db-77fd2c0d7e5a" returned: 0 in 0.255s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:51 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Lock "cinder-quobyte-159abc9d-25e7-4f24-94db-77fd2c0d7e5a" released by "_delete_snapshot" :: held 1.671s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:11:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.367s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:51 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-6a710727-8226-4436-a00d-abae30196442 req-ed1069f0-334b-48f3-940e-bc67e12af1db tempest-AttachVolumeTestJSON-77441230 None] Terminate volume connection completed successfully. Jul 21 02:11:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-6a710727-8226-4436-a00d-abae30196442 req-ed1069f0-334b-48f3-940e-bc67e12af1db tempest-AttachVolumeTestJSON-77441230 None] Deleting attachment d27b0093-ea89-46e7-96d1-202881b25e56. {{(pid=87566) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 02:11:51 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-edef173d-7d7d-4dc3-8771-1b1d2e987194 tempest-GroupsV314Test-1940193562 None] Create group from source-group-f0190e4e-69fb-48ff-aae3-7ca7aab0af74 completed successfully. Jul 21 02:11:52 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2b5f04e4-8c66-4b6d-afe3-d902a30d816b tempest-GroupsV314Test-1940193562 None] Acquiring lock "cinder-quobyte-b17bb689-c59f-4155-99ed-26f3ef6e9089" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:11:52 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2b5f04e4-8c66-4b6d-afe3-d902a30d816b tempest-GroupsV314Test-1940193562 None] Lock "cinder-quobyte-b17bb689-c59f-4155-99ed-26f3ef6e9089" acquired by "delete_volume" :: waited 0.021s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:11:52 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[407b2ee8-0aa4-4bf8-9199-610b52b74b35]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:11:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2b5f04e4-8c66-4b6d-afe3-d902a30d816b tempest-GroupsV314Test-1940193562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b17bb689-c59f-4155-99ed-26f3ef6e9089 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:52 devstack sudo[94721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b17bb689-c59f-4155-99ed-26f3ef6e9089 Jul 21 02:11:52 devstack sudo[94721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:52 devstack sudo[94721]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2b5f04e4-8c66-4b6d-afe3-d902a30d816b tempest-GroupsV314Test-1940193562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b17bb689-c59f-4155-99ed-26f3ef6e9089" returned: 0 in 0.431s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2b5f04e4-8c66-4b6d-afe3-d902a30d816b tempest-GroupsV314Test-1940193562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b17bb689-c59f-4155-99ed-26f3ef6e9089 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:52 devstack sudo[94730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b17bb689-c59f-4155-99ed-26f3ef6e9089 Jul 21 02:11:52 devstack sudo[94730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:53 devstack sudo[94730]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2b5f04e4-8c66-4b6d-afe3-d902a30d816b tempest-GroupsV314Test-1940193562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b17bb689-c59f-4155-99ed-26f3ef6e9089" returned: 0 in 0.255s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:53 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2b5f04e4-8c66-4b6d-afe3-d902a30d816b tempest-GroupsV314Test-1940193562 None] Lock "cinder-quobyte-b17bb689-c59f-4155-99ed-26f3ef6e9089" released by "delete_volume" :: held 0.752s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:11:53 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-2b5f04e4-8c66-4b6d-afe3-d902a30d816b tempest-GroupsV314Test-1940193562 None] Created reservations ['8258485a-f158-4338-b6d5-8b84cc72af8c'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:11:53 devstack cinder-volume[87566]: WARNING cinder.quota [None req-2b5f04e4-8c66-4b6d-afe3-d902a30d816b tempest-GroupsV314Test-1940193562 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-323920894 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-323920894, it is now deprecated. Please use the default quota class for default quota. Jul 21 02:11:53 devstack cinder-volume[87566]: WARNING cinder.quota [None req-2b5f04e4-8c66-4b6d-afe3-d902a30d816b tempest-GroupsV314Test-1940193562 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-323920894 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-323920894, it is now deprecated. Please use the default quota class for default quota. Jul 21 02:11:53 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-2b5f04e4-8c66-4b6d-afe3-d902a30d816b tempest-GroupsV314Test-1940193562 None] Created reservations ['3b7a1787-e5a4-438c-9f6e-8fd093de7e99', 'd2f1d5d1-8bc7-43a2-a1ec-f9c9f8e7e8a5', 'd1f110e8-125a-4668-b12c-6db48264bd4e', '44b2482a-10ef-49a3-b09b-f64075ecbf0f'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:11:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2b5f04e4-8c66-4b6d-afe3-d902a30d816b tempest-GroupsV314Test-1940193562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2b5f04e4-8c66-4b6d-afe3-d902a30d816b tempest-GroupsV314Test-1940193562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2b5f04e4-8c66-4b6d-afe3-d902a30d816b tempest-GroupsV314Test-1940193562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:11:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2b5f04e4-8c66-4b6d-afe3-d902a30d816b tempest-GroupsV314Test-1940193562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:11:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2b5f04e4-8c66-4b6d-afe3-d902a30d816b tempest-GroupsV314Test-1940193562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2b5f04e4-8c66-4b6d-afe3-d902a30d816b tempest-GroupsV314Test-1940193562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:53 devstack sudo[94733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:11:53 devstack sudo[94733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:53 devstack sudo[94733]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2b5f04e4-8c66-4b6d-afe3-d902a30d816b tempest-GroupsV314Test-1940193562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.251s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:53 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-2b5f04e4-8c66-4b6d-afe3-d902a30d816b tempest-GroupsV314Test-1940193562 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:11:53 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-2b5f04e4-8c66-4b6d-afe3-d902a30d816b tempest-GroupsV314Test-1940193562 None] Delete group completed successfully. Jul 21 02:11:53 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cb3aaeb7-6d61-4d2f-8fa8-e9b1dde835f4 tempest-GroupsV314Test-1940193562 None] Acquiring lock "cinder-quobyte-667caadf-204f-4df8-802e-920d76ee9818" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:11:53 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cb3aaeb7-6d61-4d2f-8fa8-e9b1dde835f4 tempest-GroupsV314Test-1940193562 None] Lock "cinder-quobyte-667caadf-204f-4df8-802e-920d76ee9818" acquired by "delete_volume" :: waited 0.021s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:11:53 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea17bf6-fdd0-4032-aef2-d64fa3cb8b81]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:11:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb3aaeb7-6d61-4d2f-8fa8-e9b1dde835f4 tempest-GroupsV314Test-1940193562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:54 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:11:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Flow 'volume_create_manager' (cfe77175-d413-4a26-8576-db707252b323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:11:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca399a4-1077-4a76-b0be-f8e05e3c1228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca399a4-1077-4a76-b0be-f8e05e3c1228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-9588628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2fe4e2a-5b0e-424e-bf46-ebbab770bc14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b38a11b6a03e49328e1ed99f638b051c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:11:54Z,use_quota=True,user_id='08864dfe66cd4b069579f9adf9e9e7fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c02a351-984f-4fc6-ac57-b3b248aa01d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c02a351-984f-4fc6-ac57-b3b248aa01d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4c1cc3a-a656-433b-8c66-f5ab4d14fda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:54 devstack cinder-volume[87566]: DEBUG cinder.image.glance [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Creating Keystone auth plugin from conf {{(pid=87566) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 02:11:54 devstack sudo[94736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818 Jul 21 02:11:54 devstack sudo[94736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:54 devstack sudo[94736]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb3aaeb7-6d61-4d2f-8fa8-e9b1dde835f4 tempest-GroupsV314Test-1940193562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818" returned: 0 in 0.452s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb3aaeb7-6d61-4d2f-8fa8-e9b1dde835f4 tempest-GroupsV314Test-1940193562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:54 devstack sudo[94743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818 Jul 21 02:11:54 devstack sudo[94743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4c1cc3a-a656-433b-8c66-f5ab4d14fda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f2fe4e2a-5b0e-424e-bf46-ebbab770bc14', 'volume_name': 'volume-f2fe4e2a-5b0e-424e-bf46-ebbab770bc14', 'volume_size': 1, 'image_id': '5de785ea-426a-4934-a69a-ddf7f2aebea6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5de785ea-426a-4934-a69a-ddf7f2aebea6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a8e154f63094b778a262349ffd9723e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5de785ea-426a-4934-a69a-ddf7f2aebea6', 'created_at': datetime.datetime(2026, 7, 21, 0, 0, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 0, 0, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5de785ea-426a-4934-a69a-ddf7f2aebea6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc649ec-eb62-4538-913f-37cfc3a7f7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc649ec-eb62-4538-913f-37cfc3a7f7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:11:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef6e300-d684-460a-a6de-ab5514232cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:11:54 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Volume f2fe4e2a-5b0e-424e-bf46-ebbab770bc14: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f2fe4e2a-5b0e-424e-bf46-ebbab770bc14', 'volume_size': 1, 'image_id': '5de785ea-426a-4934-a69a-ddf7f2aebea6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5de785ea-426a-4934-a69a-ddf7f2aebea6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a8e154f63094b778a262349ffd9723e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5de785ea-426a-4934-a69a-ddf7f2aebea6', 'created_at': datetime.datetime(2026, 7, 21, 0, 0, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 0, 0, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5de785ea-426a-4934-a69a-ddf7f2aebea6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 21 02:11:54 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Trying to clone f2fe4e2a-5b0e-424e-bf46-ebbab770bc14 from image 5de785ea-426a-4934-a69a-ddf7f2aebea6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5de785ea-426a-4934-a69a-ddf7f2aebea6', 'metadata': {}}]). {{(pid=87566) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 02:11:54 devstack sudo[94743]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb3aaeb7-6d61-4d2f-8fa8-e9b1dde835f4 tempest-GroupsV314Test-1940193562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-667caadf-204f-4df8-802e-920d76ee9818" returned: 0 in 0.259s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cb3aaeb7-6d61-4d2f-8fa8-e9b1dde835f4 tempest-GroupsV314Test-1940193562 None] Lock "cinder-quobyte-667caadf-204f-4df8-802e-920d76ee9818" released by "delete_volume" :: held 0.800s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:11:54 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-cb3aaeb7-6d61-4d2f-8fa8-e9b1dde835f4 tempest-GroupsV314Test-1940193562 None] Created reservations ['b526f380-609e-4035-9c00-4f349bc52301'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:11:54 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_ubya7f1pdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87566) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 02:11:54 devstack cinder-volume[87566]: INFO cinder.image.image_utils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Image download 20.69 MB at 20.69 MB/s Jul 21 02:11:55 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-cb3aaeb7-6d61-4d2f-8fa8-e9b1dde835f4 tempest-GroupsV314Test-1940193562 None] Created reservations ['80eba22f-069e-41d7-9b64-d718d9fe1e59', 'badf725e-60e5-4e8d-998a-4fa609fe6f69', 'f6e2f60a-8ed1-4e83-a40a-874c0b94f18d', '77455500-3a73-4118-89f4-edbcd9317e03'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:11:55 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6463f04-24f7-4434-a70c-daca10fc3b48]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:11:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_ubya7f1pdevstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cb3aaeb7-6d61-4d2f-8fa8-e9b1dde835f4 tempest-GroupsV314Test-1940193562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cb3aaeb7-6d61-4d2f-8fa8-e9b1dde835f4 tempest-GroupsV314Test-1940193562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cb3aaeb7-6d61-4d2f-8fa8-e9b1dde835f4 tempest-GroupsV314Test-1940193562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:11:55 devstack sudo[94774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_ubya7f1pdevstack@QuobyteHD Jul 21 02:11:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cb3aaeb7-6d61-4d2f-8fa8-e9b1dde835f4 tempest-GroupsV314Test-1940193562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:11:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cb3aaeb7-6d61-4d2f-8fa8-e9b1dde835f4 tempest-GroupsV314Test-1940193562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb3aaeb7-6d61-4d2f-8fa8-e9b1dde835f4 tempest-GroupsV314Test-1940193562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:55 devstack sudo[94774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:55 devstack sudo[94785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:11:55 devstack sudo[94785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:55 devstack sudo[94774]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_ubya7f1pdevstack@QuobyteHD" returned: 0 in 0.587s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:55 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Temporary image 5de785ea-426a-4934-a69a-ddf7f2aebea6 is fetched for user 08864dfe66cd4b069579f9adf9e9e7fd. {{(pid=87566) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 02:11:55 devstack sudo[94785]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb3aaeb7-6d61-4d2f-8fa8-e9b1dde835f4 tempest-GroupsV314Test-1940193562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.498s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:55 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-cb3aaeb7-6d61-4d2f-8fa8-e9b1dde835f4 tempest-GroupsV314Test-1940193562 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:11:55 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-cb3aaeb7-6d61-4d2f-8fa8-e9b1dde835f4 tempest-GroupsV314Test-1940193562 None] Delete group completed successfully. Jul 21 02:11:55 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cb49da-d310-4eb2-b892-1400411b0dfe]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:11:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_ubya7f1pdevstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:56 devstack sudo[94798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_ubya7f1pdevstack@QuobyteHD Jul 21 02:11:56 devstack sudo[94798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:56 devstack sudo[94798]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_ubya7f1pdevstack@QuobyteHD" returned: 0 in 0.451s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-9588628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2fe4e2a-5b0e-424e-bf46-ebbab770bc14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b38a11b6a03e49328e1ed99f638b051c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:11:54Z,use_quota=True,user_id='08864dfe66cd4b069579f9adf9e9e7fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:11:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Creating volume f2fe4e2a-5b0e-424e-bf46-ebbab770bc14 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:11:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:11:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:11:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:11:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:11:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:11:56 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:11:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f2fe4e2a-5b0e-424e-bf46-ebbab770bc14 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:56 devstack sudo[94814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f2fe4e2a-5b0e-424e-bf46-ebbab770bc14 1073741824 Jul 21 02:11:56 devstack sudo[94814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:57 devstack sudo[94814]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f2fe4e2a-5b0e-424e-bf46-ebbab770bc14 1073741824" returned: 0 in 1.063s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f2fe4e2a-5b0e-424e-bf46-ebbab770bc14 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:57 devstack sudo[94877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f2fe4e2a-5b0e-424e-bf46-ebbab770bc14 Jul 21 02:11:57 devstack sudo[94877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:58 devstack sudo[94877]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f2fe4e2a-5b0e-424e-bf46-ebbab770bc14" returned: 0 in 0.545s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:58 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:11:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:11:58 devstack cinder-volume[87566]: DEBUG cinder.volume.volume_utils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Attempting download of 5de785ea-426a-4934-a69a-ddf7f2aebea6 ((None, [{'url': 'file:///opt/stack/data/glance/images/5de785ea-426a-4934-a69a-ddf7f2aebea6', 'metadata': {}}])) to volume f2fe4e2a-5b0e-424e-bf46-ebbab770bc14. {{(pid=87566) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 02:11:58 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a006c5c-7c78-428c-836f-6dea8957f5d8]: (4, 'raw') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:11:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5de785ea-426a-4934-a69a-ddf7f2aebea6_zc6pbkyb {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:58 devstack sudo[94887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5de785ea-426a-4934-a69a-ddf7f2aebea6_zc6pbkyb Jul 21 02:11:58 devstack sudo[94887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:58 devstack sudo[94887]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5de785ea-426a-4934-a69a-ddf7f2aebea6_zc6pbkyb" returned: 0 in 0.458s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5de785ea-426a-4934-a69a-ddf7f2aebea6_zc6pbkyb {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:58 devstack sudo[94891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5de785ea-426a-4934-a69a-ddf7f2aebea6_zc6pbkyb Jul 21 02:11:58 devstack sudo[94891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:59 devstack sudo[94891]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5de785ea-426a-4934-a69a-ddf7f2aebea6_zc6pbkyb" returned: 1 in 0.429s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5de785ea-426a-4934-a69a-ddf7f2aebea6_zc6pbkyb' failed. Not Retrying. {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 02:11:59 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1292a3-7877-4156-8e50-a2e078d8d37c]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:11:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_ubya7f1pdevstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:59 devstack sudo[94897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_ubya7f1pdevstack@QuobyteHD Jul 21 02:11:59 devstack sudo[94897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:11:59 devstack sudo[94897]: pam_unix(sudo:session): session closed for user root Jul 21 02:11:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_ubya7f1pdevstack@QuobyteHD" returned: 0 in 0.460s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:11:59 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] 5de785ea-426a-4934-a69a-ddf7f2aebea6 was qcow2, converting to qcow2 {{(pid=87566) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 02:11:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_ubya7f1pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f2fe4e2a-5b0e-424e-bf46-ebbab770bc14 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:11:59 devstack sudo[94903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_ubya7f1pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f2fe4e2a-5b0e-424e-bf46-ebbab770bc14 Jul 21 02:11:59 devstack sudo[94903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:00 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:12:00 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] Flow 'volume_create_manager' (01fbbeca-9156-4bfc-b72d-f9e7dc579ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:12:00 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a08c9838-d7b5-4833-ac9e-736297d03b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:00 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a08c9838-d7b5-4833-ac9e-736297d03b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1614639967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5606c8f1-174e-4ba6-a221-3278afd40452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba729fa0b6c945f49f04b77146c16afe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:12:00Z,use_quota=True,user_id='5810e1e223f94d54a0662920d7f4d463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:00 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bcbb604-12da-42c8-925a-36513271ae33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:00 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bcbb604-12da-42c8-925a-36513271ae33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:00 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a929e929-ea9a-4d17-a696-8c40ad74e692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:00 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a929e929-ea9a-4d17-a696-8c40ad74e692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5606c8f1-174e-4ba6-a221-3278afd40452', 'volume_name': 'volume-5606c8f1-174e-4ba6-a221-3278afd40452', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:00 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9f18697-7438-4e08-8cd1-690e40f5c71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:00 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9f18697-7438-4e08-8cd1-690e40f5c71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:00 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00cb7c71-d25c-4bb6-8713-1a95a648caab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:00 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] Volume 5606c8f1-174e-4ba6-a221-3278afd40452: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5606c8f1-174e-4ba6-a221-3278afd40452', 'volume_size': 1} Jul 21 02:12:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:00 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1614639967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5606c8f1-174e-4ba6-a221-3278afd40452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba729fa0b6c945f49f04b77146c16afe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:12:00Z,use_quota=True,user_id='5810e1e223f94d54a0662920d7f4d463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:12:00 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] Creating volume 5606c8f1-174e-4ba6-a221-3278afd40452 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:12:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:00 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:12:00 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:12:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:00 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:12:00 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:12:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5606c8f1-174e-4ba6-a221-3278afd40452 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:00 devstack sudo[94913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5606c8f1-174e-4ba6-a221-3278afd40452 1073741824 Jul 21 02:12:00 devstack sudo[94913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:01 devstack sudo[94913]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5606c8f1-174e-4ba6-a221-3278afd40452 1073741824" returned: 0 in 0.807s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5606c8f1-174e-4ba6-a221-3278afd40452 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:01 devstack sudo[94919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5606c8f1-174e-4ba6-a221-3278afd40452 Jul 21 02:12:01 devstack sudo[94919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:01 devstack sudo[94919]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5606c8f1-174e-4ba6-a221-3278afd40452" returned: 0 in 0.310s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:01 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:12:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:01 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00cb7c71-d25c-4bb6-8713-1a95a648caab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5606c8f1-174e-4ba6-a221-3278afd40452', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:01 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd7dfc37-44a5-47ec-b112-80a5246c293d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:01 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] Volume volume-5606c8f1-174e-4ba6-a221-3278afd40452 (5606c8f1-174e-4ba6-a221-3278afd40452): created successfully Jul 21 02:12:01 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd7dfc37-44a5-47ec-b112-80a5246c293d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:01 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] Flow 'volume_create_manager' (01fbbeca-9156-4bfc-b72d-f9e7dc579ebc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:12:01 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-507bd12d-43e0-4efe-a9f7-1267b6fb5f19 tempest-AttachVolumeNegativeTest-1066125899 None] Created volume successfully. Jul 21 02:12:01 devstack sudo[94903]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_ubya7f1pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f2fe4e2a-5b0e-424e-bf46-ebbab770bc14" returned: 0 in 2.379s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:01 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_ubya7f1pdevstack@QuobyteHD, size 112.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f2fe4e2a-5b0e-424e-bf46-ebbab770bc14 {{(pid=87566) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 02:12:01 devstack cinder-volume[87566]: INFO cinder.image.image_utils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Converted 112.00 MB image at 47.04 MB/s Jul 21 02:12:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f2fe4e2a-5b0e-424e-bf46-ebbab770bc14 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:01 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f2fe4e2a-5b0e-424e-bf46-ebbab770bc14 1G Jul 21 02:12:01 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:02 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f2fe4e2a-5b0e-424e-bf46-ebbab770bc14 1G" returned: 0 in 0.364s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:02 devstack cinder-volume[87566]: DEBUG cinder.volume.volume_utils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Downloaded image 5de785ea-426a-4934-a69a-ddf7f2aebea6 ((None, [{'url': 'file:///opt/stack/data/glance/images/5de785ea-426a-4934-a69a-ddf7f2aebea6', 'metadata': {}}])) to volume f2fe4e2a-5b0e-424e-bf46-ebbab770bc14 successfully. {{(pid=87566) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 02:12:02 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Temporary image 5de785ea-426a-4934-a69a-ddf7f2aebea6 for user 08864dfe66cd4b069579f9adf9e9e7fd is deleted. {{(pid=87566) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 02:12:02 devstack cinder-volume[87566]: DEBUG cinder.volume.volume_utils [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Marking volume f2fe4e2a-5b0e-424e-bf46-ebbab770bc14 as bootable. {{(pid=87566) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 02:12:02 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Copying metadata from image 5de785ea-426a-4934-a69a-ddf7f2aebea6 to f2fe4e2a-5b0e-424e-bf46-ebbab770bc14. {{(pid=87566) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 02:12:02 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Creating volume glance metadata for volume f2fe4e2a-5b0e-424e-bf46-ebbab770bc14 backed by image 5de785ea-426a-4934-a69a-ddf7f2aebea6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5de785ea-426a-4934-a69a-ddf7f2aebea6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87566) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 02:12:02 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef6e300-d684-460a-a6de-ab5514232cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2fe4e2a-5b0e-424e-bf46-ebbab770bc14', 'volume_size': 1, 'image_id': '5de785ea-426a-4934-a69a-ddf7f2aebea6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5de785ea-426a-4934-a69a-ddf7f2aebea6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a8e154f63094b778a262349ffd9723e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5de785ea-426a-4934-a69a-ddf7f2aebea6', 'created_at': datetime.datetime(2026, 7, 21, 0, 0, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 0, 0, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5de785ea-426a-4934-a69a-ddf7f2aebea6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:02 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4f11762-3e1f-410c-a602-f0a37e65a546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:02 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Volume volume-f2fe4e2a-5b0e-424e-bf46-ebbab770bc14 (f2fe4e2a-5b0e-424e-bf46-ebbab770bc14): created successfully Jul 21 02:12:02 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4f11762-3e1f-410c-a602-f0a37e65a546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:02 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Flow 'volume_create_manager' (cfe77175-d413-4a26-8576-db707252b323) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:12:02 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-aba763b6-aff5-40b7-b94b-87a008660ae7 tempest-VolumesImageMetadata-1961925664 None] Created volume successfully. Jul 21 02:12:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b743e3a6-e58c-41c6-a13d-a754046a14bc tempest-VolumesImageMetadata-1961925664 None] Acquiring lock "cinder-f2fe4e2a-5b0e-424e-bf46-ebbab770bc14-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:12:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b743e3a6-e58c-41c6-a13d-a754046a14bc tempest-VolumesImageMetadata-1961925664 None] Lock "cinder-f2fe4e2a-5b0e-424e-bf46-ebbab770bc14-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:12:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b743e3a6-e58c-41c6-a13d-a754046a14bc tempest-VolumesImageMetadata-1961925664 None] Acquiring lock "cinder-quobyte-f2fe4e2a-5b0e-424e-bf46-ebbab770bc14" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:12:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b743e3a6-e58c-41c6-a13d-a754046a14bc tempest-VolumesImageMetadata-1961925664 None] Lock "cinder-quobyte-f2fe4e2a-5b0e-424e-bf46-ebbab770bc14" acquired by "delete_volume" :: waited 0.018s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:12:03 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6286408-f0a7-48c7-a556-bd36eede6af1]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:12:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b743e3a6-e58c-41c6-a13d-a754046a14bc tempest-VolumesImageMetadata-1961925664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f2fe4e2a-5b0e-424e-bf46-ebbab770bc14 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:03 devstack sudo[94939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f2fe4e2a-5b0e-424e-bf46-ebbab770bc14 Jul 21 02:12:03 devstack sudo[94939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-7a822d12-d78a-4b59-9fe9-66ff0f3037ad req-7b58b72b-73b5-4787-bdcf-c6140fab11ac tempest-AttachVolumeNegativeTest-1066125899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-7a822d12-d78a-4b59-9fe9-66ff0f3037ad req-7b58b72b-73b5-4787-bdcf-c6140fab11ac tempest-AttachVolumeNegativeTest-1066125899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-7a822d12-d78a-4b59-9fe9-66ff0f3037ad req-7b58b72b-73b5-4787-bdcf-c6140fab11ac tempest-AttachVolumeNegativeTest-1066125899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:03 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-7a822d12-d78a-4b59-9fe9-66ff0f3037ad req-7b58b72b-73b5-4787-bdcf-c6140fab11ac tempest-AttachVolumeNegativeTest-1066125899 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea', 'name': 'volume-5606c8f1-174e-4ba6-a221-3278afd40452', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'da574d6b-cca3-4b37-b324-b284aee9f6e1', 'enforce_multipath': True} {{(pid=87566) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 02:12:03 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-7a822d12-d78a-4b59-9fe9-66ff0f3037ad req-7b58b72b-73b5-4787-bdcf-c6140fab11ac tempest-AttachVolumeNegativeTest-1066125899 None] attachment_update completed successfully. Jul 21 02:12:03 devstack sudo[94939]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b743e3a6-e58c-41c6-a13d-a754046a14bc tempest-VolumesImageMetadata-1961925664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f2fe4e2a-5b0e-424e-bf46-ebbab770bc14" returned: 0 in 0.497s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b743e3a6-e58c-41c6-a13d-a754046a14bc tempest-VolumesImageMetadata-1961925664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f2fe4e2a-5b0e-424e-bf46-ebbab770bc14 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:04 devstack sudo[94953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f2fe4e2a-5b0e-424e-bf46-ebbab770bc14 Jul 21 02:12:04 devstack sudo[94953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:04 devstack sudo[94953]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b743e3a6-e58c-41c6-a13d-a754046a14bc tempest-VolumesImageMetadata-1961925664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f2fe4e2a-5b0e-424e-bf46-ebbab770bc14" returned: 0 in 0.393s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:04 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b743e3a6-e58c-41c6-a13d-a754046a14bc tempest-VolumesImageMetadata-1961925664 None] Lock "cinder-quobyte-f2fe4e2a-5b0e-424e-bf46-ebbab770bc14" released by "delete_volume" :: held 0.965s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:12:04 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-b743e3a6-e58c-41c6-a13d-a754046a14bc tempest-VolumesImageMetadata-1961925664 None] Created reservations ['63f40dc1-c20a-41ad-8392-4b61305f7ec5', '73a8a8ef-d7bb-484a-8cec-9f1b7ddafec6', '470f53b5-abe0-4d18-881b-a334d730afea', 'f95ab23b-af36-4c26-a1c9-49a911bda9ee'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:12:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b743e3a6-e58c-41c6-a13d-a754046a14bc tempest-VolumesImageMetadata-1961925664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b743e3a6-e58c-41c6-a13d-a754046a14bc tempest-VolumesImageMetadata-1961925664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:04 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b743e3a6-e58c-41c6-a13d-a754046a14bc tempest-VolumesImageMetadata-1961925664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:12:04 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b743e3a6-e58c-41c6-a13d-a754046a14bc tempest-VolumesImageMetadata-1961925664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:12:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b743e3a6-e58c-41c6-a13d-a754046a14bc tempest-VolumesImageMetadata-1961925664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b743e3a6-e58c-41c6-a13d-a754046a14bc tempest-VolumesImageMetadata-1961925664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:04 devstack sudo[95337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:12:04 devstack sudo[95337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:04 devstack sudo[95337]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b743e3a6-e58c-41c6-a13d-a754046a14bc tempest-VolumesImageMetadata-1961925664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.304s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:04 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-b743e3a6-e58c-41c6-a13d-a754046a14bc tempest-VolumesImageMetadata-1961925664 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:12:04 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-b743e3a6-e58c-41c6-a13d-a754046a14bc tempest-VolumesImageMetadata-1961925664 None] Deleted volume successfully. Jul 21 02:12:04 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b743e3a6-e58c-41c6-a13d-a754046a14bc tempest-VolumesImageMetadata-1961925664 None] Lock "cinder-f2fe4e2a-5b0e-424e-bf46-ebbab770bc14-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:12:06 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-3bf5c883-4650-469b-99f6-ec927a3a579e req-5a7181ef-085d-4341-a400-43b8de2ce4f8 tempest-AttachVolumeNegativeTest-1066125899 None] Terminate volume connection completed successfully. Jul 21 02:12:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-3bf5c883-4650-469b-99f6-ec927a3a579e req-5a7181ef-085d-4341-a400-43b8de2ce4f8 tempest-AttachVolumeNegativeTest-1066125899 None] Deleting attachment da574d6b-cca3-4b37-b324-b284aee9f6e1. {{(pid=87566) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 02:12:12 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:12:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] Flow 'volume_create_manager' (77d830db-488a-44a0-8165-a7e7351b9154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:12:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aaf4496-1e42-474e-baa3-37ba6ca885d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aaf4496-1e42-474e-baa3-37ba6ca885d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-439014809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=085551c1-2b9e-438c-a87e-701c9c4dd39a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd2ed4916d1c4a889eae89ce112da1b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:12:13Z,use_quota=True,user_id='08382cb12ff741608d2960e86f5b16a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a458245-4290-4ea4-8e9c-cf76bac42258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a458245-4290-4ea4-8e9c-cf76bac42258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8175c62-4f79-41ad-802a-330f05016d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8175c62-4f79-41ad-802a-330f05016d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '085551c1-2b9e-438c-a87e-701c9c4dd39a', 'volume_name': 'volume-085551c1-2b9e-438c-a87e-701c9c4dd39a', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d5d721-d1c2-4559-a1c9-41a0dce780c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d5d721-d1c2-4559-a1c9-41a0dce780c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ba433a4-f1c5-4275-a09a-defb64260daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:12 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] Volume 085551c1-2b9e-438c-a87e-701c9c4dd39a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-085551c1-2b9e-438c-a87e-701c9c4dd39a', 'volume_size': 1} Jul 21 02:12:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-439014809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=085551c1-2b9e-438c-a87e-701c9c4dd39a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd2ed4916d1c4a889eae89ce112da1b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:12:13Z,use_quota=True,user_id='08382cb12ff741608d2960e86f5b16a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:12:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] Creating volume 085551c1-2b9e-438c-a87e-701c9c4dd39a {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:12:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:12:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:12:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:12:12 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:12:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-085551c1-2b9e-438c-a87e-701c9c4dd39a 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:12 devstack sudo[95408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-085551c1-2b9e-438c-a87e-701c9c4dd39a 1073741824 Jul 21 02:12:12 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:13 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-085551c1-2b9e-438c-a87e-701c9c4dd39a 1073741824" returned: 0 in 0.503s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-085551c1-2b9e-438c-a87e-701c9c4dd39a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:13 devstack sudo[95414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-085551c1-2b9e-438c-a87e-701c9c4dd39a Jul 21 02:12:13 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:13 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-085551c1-2b9e-438c-a87e-701c9c4dd39a" returned: 0 in 0.272s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:12:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ba433a4-f1c5-4275-a09a-defb64260daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-085551c1-2b9e-438c-a87e-701c9c4dd39a', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e1c4b8-94b0-49b6-b34b-3617146e76b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:13 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] Volume volume-085551c1-2b9e-438c-a87e-701c9c4dd39a (085551c1-2b9e-438c-a87e-701c9c4dd39a): created successfully Jul 21 02:12:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e1c4b8-94b0-49b6-b34b-3617146e76b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] Flow 'volume_create_manager' (77d830db-488a-44a0-8165-a7e7351b9154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:12:13 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-560f6268-17c5-423d-b0db-e135a695094e tempest-VolumesTransfersTest-1716292867 None] Created volume successfully. Jul 21 02:12:15 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-0f4a34d5-489d-4df1-a2f4-791db95c4c96 tempest-VolumesTransfersTest-667746846 None] Transfer volume completed successfully. Jul 21 02:12:16 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:12:16 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] Flow 'volume_create_manager' (ee0f36e1-9df3-4ead-a760-77997046b024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:12:16 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11648c35-2761-4f84-a373-ade9f4e8a163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:16 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11648c35-2761-4f84-a373-ade9f4e8a163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-231455856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d86af9f1-bd36-4330-bfa5-5cc9e8b91e6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d571212d8464fa8a6860e3253bcb7ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:12:16Z,use_quota=True,user_id='083e67352b8448f9880e14cbae740731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:16 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ae53f91-d023-4dcf-8a0a-56a4b9ccdff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:16 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ae53f91-d023-4dcf-8a0a-56a4b9ccdff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:16 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2faa3fcb-0912-4e2a-a34c-64415847ba09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:16 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2faa3fcb-0912-4e2a-a34c-64415847ba09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd86af9f1-bd36-4330-bfa5-5cc9e8b91e6e', 'volume_name': 'volume-d86af9f1-bd36-4330-bfa5-5cc9e8b91e6e', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:16 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4973d25c-b895-41f3-be9b-d092b04f6fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:16 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4973d25c-b895-41f3-be9b-d092b04f6fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:16 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ca8820-156a-4255-8a25-dafefb405252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:16 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] Volume d86af9f1-bd36-4330-bfa5-5cc9e8b91e6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d86af9f1-bd36-4330-bfa5-5cc9e8b91e6e', 'volume_size': 1} Jul 21 02:12:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:16 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-231455856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d86af9f1-bd36-4330-bfa5-5cc9e8b91e6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d571212d8464fa8a6860e3253bcb7ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:12:16Z,use_quota=True,user_id='083e67352b8448f9880e14cbae740731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:12:16 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] Creating volume d86af9f1-bd36-4330-bfa5-5cc9e8b91e6e {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:12:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:16 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:12:16 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:12:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:16 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:12:16 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:12:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d86af9f1-bd36-4330-bfa5-5cc9e8b91e6e 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:16 devstack sudo[95417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d86af9f1-bd36-4330-bfa5-5cc9e8b91e6e 1073741824 Jul 21 02:12:16 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:16 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b222092a-5450-454e-b4ea-a91f407050d5 tempest-VolumesTransfersTest-1239336464 None] Acquiring lock "cinder-085551c1-2b9e-438c-a87e-701c9c4dd39a-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:12:16 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b222092a-5450-454e-b4ea-a91f407050d5 tempest-VolumesTransfersTest-1239336464 None] Lock "cinder-085551c1-2b9e-438c-a87e-701c9c4dd39a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:12:16 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b222092a-5450-454e-b4ea-a91f407050d5 tempest-VolumesTransfersTest-1239336464 None] Acquiring lock "cinder-quobyte-085551c1-2b9e-438c-a87e-701c9c4dd39a" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:12:16 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b222092a-5450-454e-b4ea-a91f407050d5 tempest-VolumesTransfersTest-1239336464 None] Lock "cinder-quobyte-085551c1-2b9e-438c-a87e-701c9c4dd39a" acquired by "delete_volume" :: waited 0.023s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:12:16 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[95964977-053a-41ba-bbc9-af1a04dc3d6a]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:12:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b222092a-5450-454e-b4ea-a91f407050d5 tempest-VolumesTransfersTest-1239336464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-085551c1-2b9e-438c-a87e-701c9c4dd39a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:16 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-085551c1-2b9e-438c-a87e-701c9c4dd39a Jul 21 02:12:16 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:16 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d86af9f1-bd36-4330-bfa5-5cc9e8b91e6e 1073741824" returned: 0 in 0.707s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d86af9f1-bd36-4330-bfa5-5cc9e8b91e6e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:17 devstack sudo[95428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d86af9f1-bd36-4330-bfa5-5cc9e8b91e6e Jul 21 02:12:17 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:17 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b222092a-5450-454e-b4ea-a91f407050d5 tempest-VolumesTransfersTest-1239336464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-085551c1-2b9e-438c-a87e-701c9c4dd39a" returned: 0 in 0.545s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b222092a-5450-454e-b4ea-a91f407050d5 tempest-VolumesTransfersTest-1239336464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-085551c1-2b9e-438c-a87e-701c9c4dd39a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:17 devstack sudo[95435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-085551c1-2b9e-438c-a87e-701c9c4dd39a Jul 21 02:12:17 devstack sudo[95435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:17 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d86af9f1-bd36-4330-bfa5-5cc9e8b91e6e" returned: 0 in 0.343s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:17 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:12:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:17 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ca8820-156a-4255-8a25-dafefb405252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d86af9f1-bd36-4330-bfa5-5cc9e8b91e6e', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:17 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab1b1288-7de4-4d38-9650-bd212c34128b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:17 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] Volume volume-d86af9f1-bd36-4330-bfa5-5cc9e8b91e6e (d86af9f1-bd36-4330-bfa5-5cc9e8b91e6e): created successfully Jul 21 02:12:17 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab1b1288-7de4-4d38-9650-bd212c34128b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:17 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] Flow 'volume_create_manager' (ee0f36e1-9df3-4ead-a760-77997046b024) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:12:17 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-9c7c6a38-b6bc-4bd6-8df4-079a5e7ea3b7 tempest-VolumesServicesTestJSON-1510639176 None] Created volume successfully. Jul 21 02:12:17 devstack sudo[95435]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b222092a-5450-454e-b4ea-a91f407050d5 tempest-VolumesTransfersTest-1239336464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-085551c1-2b9e-438c-a87e-701c9c4dd39a" returned: 0 in 0.307s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b222092a-5450-454e-b4ea-a91f407050d5 tempest-VolumesTransfersTest-1239336464 None] Lock "cinder-quobyte-085551c1-2b9e-438c-a87e-701c9c4dd39a" released by "delete_volume" :: held 0.906s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:12:17 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-b222092a-5450-454e-b4ea-a91f407050d5 tempest-VolumesTransfersTest-1239336464 None] Created reservations ['52f8cb98-d0ac-4aa6-8fc0-1d2583c2b276', '1e185be4-4edc-4705-bdf6-c4a33e8ae493', '0627cc6a-12b2-4185-a5fc-b889c576cdf0', '12f34796-b95a-44b0-ab35-629544119ebe'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:12:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b222092a-5450-454e-b4ea-a91f407050d5 tempest-VolumesTransfersTest-1239336464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b222092a-5450-454e-b4ea-a91f407050d5 tempest-VolumesTransfersTest-1239336464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:17 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b222092a-5450-454e-b4ea-a91f407050d5 tempest-VolumesTransfersTest-1239336464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:12:17 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b222092a-5450-454e-b4ea-a91f407050d5 tempest-VolumesTransfersTest-1239336464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:12:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b222092a-5450-454e-b4ea-a91f407050d5 tempest-VolumesTransfersTest-1239336464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b222092a-5450-454e-b4ea-a91f407050d5 tempest-VolumesTransfersTest-1239336464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:17 devstack sudo[95439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:12:17 devstack sudo[95439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:17 devstack sudo[95439]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b222092a-5450-454e-b4ea-a91f407050d5 tempest-VolumesTransfersTest-1239336464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.304s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:17 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-b222092a-5450-454e-b4ea-a91f407050d5 tempest-VolumesTransfersTest-1239336464 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:12:18 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-b222092a-5450-454e-b4ea-a91f407050d5 tempest-VolumesTransfersTest-1239336464 None] Deleted volume successfully. Jul 21 02:12:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b222092a-5450-454e-b4ea-a91f407050d5 tempest-VolumesTransfersTest-1239336464 None] Lock "cinder-085551c1-2b9e-438c-a87e-701c9c4dd39a-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:12:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-927caf05-310b-4dca-944b-0cc1ff418afa tempest-VolumesServicesTestJSON-1510639176 None] Acquiring lock "cinder-d86af9f1-bd36-4330-bfa5-5cc9e8b91e6e-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:12:18 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:12:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] Flow 'volume_create_manager' (1d811321-9913-426d-846b-b2a01facda4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:12:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7598987-ccf3-439f-87a6-b7d6a70ff9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-927caf05-310b-4dca-944b-0cc1ff418afa tempest-VolumesServicesTestJSON-1510639176 None] Lock "cinder-d86af9f1-bd36-4330-bfa5-5cc9e8b91e6e-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:12:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7598987-ccf3-439f-87a6-b7d6a70ff9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-264182134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d45a66e-6ec3-444d-884b-be20e251375b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd2ed4916d1c4a889eae89ce112da1b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:12:18Z,use_quota=True,user_id='08382cb12ff741608d2960e86f5b16a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e80774b6-f9b9-49ef-9a23-0d3bf4fbd0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e80774b6-f9b9-49ef-9a23-0d3bf4fbd0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d7ff39f-2110-4b41-b967-e00e3d123c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d7ff39f-2110-4b41-b967-e00e3d123c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d45a66e-6ec3-444d-884b-be20e251375b', 'volume_name': 'volume-4d45a66e-6ec3-444d-884b-be20e251375b', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7248d684-7ed2-469b-bddc-83714275d121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7248d684-7ed2-469b-bddc-83714275d121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b91739d-f42a-48ae-b003-bc5fe85e1c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:18 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] Volume 4d45a66e-6ec3-444d-884b-be20e251375b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d45a66e-6ec3-444d-884b-be20e251375b', 'volume_size': 1} Jul 21 02:12:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-264182134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d45a66e-6ec3-444d-884b-be20e251375b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd2ed4916d1c4a889eae89ce112da1b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:12:18Z,use_quota=True,user_id='08382cb12ff741608d2960e86f5b16a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:12:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] Creating volume 4d45a66e-6ec3-444d-884b-be20e251375b {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:12:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:12:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:12:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:12:18 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:12:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4d45a66e-6ec3-444d-884b-be20e251375b 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:18 devstack sudo[95448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4d45a66e-6ec3-444d-884b-be20e251375b 1073741824 Jul 21 02:12:18 devstack sudo[95448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-927caf05-310b-4dca-944b-0cc1ff418afa tempest-VolumesServicesTestJSON-1510639176 None] Acquiring lock "cinder-quobyte-d86af9f1-bd36-4330-bfa5-5cc9e8b91e6e" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:12:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-927caf05-310b-4dca-944b-0cc1ff418afa tempest-VolumesServicesTestJSON-1510639176 None] Lock "cinder-quobyte-d86af9f1-bd36-4330-bfa5-5cc9e8b91e6e" acquired by "delete_volume" :: waited 0.031s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:12:18 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be05268-84c4-4c86-8c05-43377919a85f]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:12:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-927caf05-310b-4dca-944b-0cc1ff418afa tempest-VolumesServicesTestJSON-1510639176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d86af9f1-bd36-4330-bfa5-5cc9e8b91e6e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:19 devstack sudo[95450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d86af9f1-bd36-4330-bfa5-5cc9e8b91e6e Jul 21 02:12:19 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:19 devstack sudo[95448]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4d45a66e-6ec3-444d-884b-be20e251375b 1073741824" returned: 0 in 0.834s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4d45a66e-6ec3-444d-884b-be20e251375b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:19 devstack sudo[95481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4d45a66e-6ec3-444d-884b-be20e251375b Jul 21 02:12:19 devstack sudo[95481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:19 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-927caf05-310b-4dca-944b-0cc1ff418afa tempest-VolumesServicesTestJSON-1510639176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d86af9f1-bd36-4330-bfa5-5cc9e8b91e6e" returned: 0 in 0.877s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-927caf05-310b-4dca-944b-0cc1ff418afa tempest-VolumesServicesTestJSON-1510639176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d86af9f1-bd36-4330-bfa5-5cc9e8b91e6e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:19 devstack sudo[95490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d86af9f1-bd36-4330-bfa5-5cc9e8b91e6e Jul 21 02:12:19 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:20 devstack sudo[95481]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4d45a66e-6ec3-444d-884b-be20e251375b" returned: 0 in 0.430s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:20 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:12:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:20 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b91739d-f42a-48ae-b003-bc5fe85e1c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d45a66e-6ec3-444d-884b-be20e251375b', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:20 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3c4eb98-f8fa-4f2f-bf3e-94bf2c6130f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:20 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-927caf05-310b-4dca-944b-0cc1ff418afa tempest-VolumesServicesTestJSON-1510639176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d86af9f1-bd36-4330-bfa5-5cc9e8b91e6e" returned: 0 in 0.358s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:20 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] Volume volume-4d45a66e-6ec3-444d-884b-be20e251375b (4d45a66e-6ec3-444d-884b-be20e251375b): created successfully Jul 21 02:12:20 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3c4eb98-f8fa-4f2f-bf3e-94bf2c6130f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:20 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] Flow 'volume_create_manager' (1d811321-9913-426d-846b-b2a01facda4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:12:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-927caf05-310b-4dca-944b-0cc1ff418afa tempest-VolumesServicesTestJSON-1510639176 None] Lock "cinder-quobyte-d86af9f1-bd36-4330-bfa5-5cc9e8b91e6e" released by "delete_volume" :: held 1.371s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:12:20 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-b90a2878-7748-4d88-a9de-dad75a03d1b8 tempest-VolumesTransfersTest-1716292867 None] Created volume successfully. Jul 21 02:12:20 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-927caf05-310b-4dca-944b-0cc1ff418afa tempest-VolumesServicesTestJSON-1510639176 None] Created reservations ['4e44a6dc-65ec-4c40-8092-2f15ac45ccf3', '8448efd2-0a7c-492c-9140-f0da651e7578', '1d75f026-87df-43f0-8e0e-4cc16c2ff402', '18a0cb3f-ff40-4300-a0b9-f3f03e1424d3'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:12:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-927caf05-310b-4dca-944b-0cc1ff418afa tempest-VolumesServicesTestJSON-1510639176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-927caf05-310b-4dca-944b-0cc1ff418afa tempest-VolumesServicesTestJSON-1510639176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:20 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-927caf05-310b-4dca-944b-0cc1ff418afa tempest-VolumesServicesTestJSON-1510639176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:12:20 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-927caf05-310b-4dca-944b-0cc1ff418afa tempest-VolumesServicesTestJSON-1510639176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:12:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-927caf05-310b-4dca-944b-0cc1ff418afa tempest-VolumesServicesTestJSON-1510639176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-927caf05-310b-4dca-944b-0cc1ff418afa tempest-VolumesServicesTestJSON-1510639176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:20 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:12:20 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:20 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-927caf05-310b-4dca-944b-0cc1ff418afa tempest-VolumesServicesTestJSON-1510639176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.281s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:20 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-927caf05-310b-4dca-944b-0cc1ff418afa tempest-VolumesServicesTestJSON-1510639176 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:12:20 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-927caf05-310b-4dca-944b-0cc1ff418afa tempest-VolumesServicesTestJSON-1510639176 None] Deleted volume successfully. Jul 21 02:12:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-927caf05-310b-4dca-944b-0cc1ff418afa tempest-VolumesServicesTestJSON-1510639176 None] Lock "cinder-d86af9f1-bd36-4330-bfa5-5cc9e8b91e6e-delete_volume" released by "delete_volume" :: held 2.090s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:12:21 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2d2634f4-9d05-4849-9942-9ac13faccb63 tempest-VolumesTransfersTest-1239336464 None] Acquiring lock "cinder-4d45a66e-6ec3-444d-884b-be20e251375b-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:12:21 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2d2634f4-9d05-4849-9942-9ac13faccb63 tempest-VolumesTransfersTest-1239336464 None] Lock "cinder-4d45a66e-6ec3-444d-884b-be20e251375b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:12:21 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2d2634f4-9d05-4849-9942-9ac13faccb63 tempest-VolumesTransfersTest-1239336464 None] Acquiring lock "cinder-quobyte-4d45a66e-6ec3-444d-884b-be20e251375b" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:12:21 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2d2634f4-9d05-4849-9942-9ac13faccb63 tempest-VolumesTransfersTest-1239336464 None] Lock "cinder-quobyte-4d45a66e-6ec3-444d-884b-be20e251375b" acquired by "delete_volume" :: waited 0.018s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:12:21 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f02a57c-6f46-4de6-9eed-22d18d9064fe]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:12:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2d2634f4-9d05-4849-9942-9ac13faccb63 tempest-VolumesTransfersTest-1239336464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4d45a66e-6ec3-444d-884b-be20e251375b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:21 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4d45a66e-6ec3-444d-884b-be20e251375b Jul 21 02:12:21 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:21 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2d2634f4-9d05-4849-9942-9ac13faccb63 tempest-VolumesTransfersTest-1239336464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4d45a66e-6ec3-444d-884b-be20e251375b" returned: 0 in 0.532s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2d2634f4-9d05-4849-9942-9ac13faccb63 tempest-VolumesTransfersTest-1239336464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4d45a66e-6ec3-444d-884b-be20e251375b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:21 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4d45a66e-6ec3-444d-884b-be20e251375b Jul 21 02:12:21 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:22 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2d2634f4-9d05-4849-9942-9ac13faccb63 tempest-VolumesTransfersTest-1239336464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4d45a66e-6ec3-444d-884b-be20e251375b" returned: 0 in 0.518s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2d2634f4-9d05-4849-9942-9ac13faccb63 tempest-VolumesTransfersTest-1239336464 None] Lock "cinder-quobyte-4d45a66e-6ec3-444d-884b-be20e251375b" released by "delete_volume" :: held 1.106s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:12:22 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-2d2634f4-9d05-4849-9942-9ac13faccb63 tempest-VolumesTransfersTest-1239336464 None] Created reservations ['984b3124-a145-4cf2-91d1-fb5a6865b0fb', 'a6d8fbcf-e0ff-4705-9536-a3390652e90c', 'ca9b43c2-480c-4d1f-ac80-6000e02bff39', '62d647ce-634a-4ca9-b390-da13288d05a2'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:12:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2d2634f4-9d05-4849-9942-9ac13faccb63 tempest-VolumesTransfersTest-1239336464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2d2634f4-9d05-4849-9942-9ac13faccb63 tempest-VolumesTransfersTest-1239336464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:22 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2d2634f4-9d05-4849-9942-9ac13faccb63 tempest-VolumesTransfersTest-1239336464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:12:22 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2d2634f4-9d05-4849-9942-9ac13faccb63 tempest-VolumesTransfersTest-1239336464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:12:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2d2634f4-9d05-4849-9942-9ac13faccb63 tempest-VolumesTransfersTest-1239336464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2d2634f4-9d05-4849-9942-9ac13faccb63 tempest-VolumesTransfersTest-1239336464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:22 devstack sudo[95556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:12:22 devstack sudo[95556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:23 devstack sudo[95556]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2d2634f4-9d05-4849-9942-9ac13faccb63 tempest-VolumesTransfersTest-1239336464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.581s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:23 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-2d2634f4-9d05-4849-9942-9ac13faccb63 tempest-VolumesTransfersTest-1239336464 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:12:23 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-2d2634f4-9d05-4849-9942-9ac13faccb63 tempest-VolumesTransfersTest-1239336464 None] Deleted volume successfully. Jul 21 02:12:23 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2d2634f4-9d05-4849-9942-9ac13faccb63 tempest-VolumesTransfersTest-1239336464 None] Lock "cinder-4d45a66e-6ec3-444d-884b-be20e251375b-delete_volume" released by "delete_volume" :: held 2.261s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:12:31 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:12:31 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] Flow 'volume_create_manager' (5f5d0e85-39c4-4b99-af48-da931aa4133f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:12:31 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f842669-1ab4-4f8d-9199-309ea444b41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:31 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f842669-1ab4-4f8d-9199-309ea444b41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1195785578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=547fc4d6-b14d-4a09-85d6-654afdc9fa66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700f5558f5b44d4aaa748abf04a869cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:12:31Z,use_quota=True,user_id='ba98a3a979954e259d83b94f6be9343b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d89b-27e9-4372-825c-fe92ffba6b6b),volume_type_id=ee84d89b-27e9-4372-825c-fe92ffba6b6b)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:31 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b9ac71-aad5-4739-9bfc-ed7f8e5c21d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:31 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b9ac71-aad5-4739-9bfc-ed7f8e5c21d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:31 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0ffb5f5-5496-4e56-a82c-05354526161a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:31 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0ffb5f5-5496-4e56-a82c-05354526161a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '547fc4d6-b14d-4a09-85d6-654afdc9fa66', 'volume_name': 'volume-547fc4d6-b14d-4a09-85d6-654afdc9fa66', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:31 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f84008ea-fc18-4420-b61b-5e3c48bc71ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:31 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f84008ea-fc18-4420-b61b-5e3c48bc71ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:31 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad504edb-1c26-4a54-9287-5ad77fc1ec73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:31 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] Volume 547fc4d6-b14d-4a09-85d6-654afdc9fa66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-547fc4d6-b14d-4a09-85d6-654afdc9fa66', 'volume_size': 1} Jul 21 02:12:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:31 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1195785578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=547fc4d6-b14d-4a09-85d6-654afdc9fa66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700f5558f5b44d4aaa748abf04a869cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:12:31Z,use_quota=True,user_id='ba98a3a979954e259d83b94f6be9343b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d89b-27e9-4372-825c-fe92ffba6b6b),volume_type_id=ee84d89b-27e9-4372-825c-fe92ffba6b6b)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:12:31 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] Creating volume 547fc4d6-b14d-4a09-85d6-654afdc9fa66 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:12:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:31 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:12:31 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:12:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:31 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:12:31 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:12:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-547fc4d6-b14d-4a09-85d6-654afdc9fa66 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:31 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-547fc4d6-b14d-4a09-85d6-654afdc9fa66 1073741824 Jul 21 02:12:31 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:32 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-547fc4d6-b14d-4a09-85d6-654afdc9fa66 1073741824" returned: 0 in 0.650s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-547fc4d6-b14d-4a09-85d6-654afdc9fa66 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:32 devstack sudo[95607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-547fc4d6-b14d-4a09-85d6-654afdc9fa66 Jul 21 02:12:32 devstack sudo[95607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:32 devstack sudo[95607]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-547fc4d6-b14d-4a09-85d6-654afdc9fa66" returned: 0 in 0.521s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:32 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:12:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad504edb-1c26-4a54-9287-5ad77fc1ec73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-547fc4d6-b14d-4a09-85d6-654afdc9fa66', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc574d77-1bce-4574-bb31-9280dd944309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:32 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] Volume volume-547fc4d6-b14d-4a09-85d6-654afdc9fa66 (547fc4d6-b14d-4a09-85d6-654afdc9fa66): created successfully Jul 21 02:12:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc574d77-1bce-4574-bb31-9280dd944309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] Flow 'volume_create_manager' (5f5d0e85-39c4-4b99-af48-da931aa4133f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:12:32 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-57c34b71-d05e-4ac4-a4e6-68dade379339 tempest-VolumeTypesAccessTest-1817094688 None] Created volume successfully. Jul 21 02:12:33 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d2939234-f057-48ff-8627-c101d7990da5 tempest-VolumeTypesAccessTest-1817094688 None] Acquiring lock "cinder-547fc4d6-b14d-4a09-85d6-654afdc9fa66-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:12:33 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d2939234-f057-48ff-8627-c101d7990da5 tempest-VolumeTypesAccessTest-1817094688 None] Lock "cinder-547fc4d6-b14d-4a09-85d6-654afdc9fa66-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:12:33 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d2939234-f057-48ff-8627-c101d7990da5 tempest-VolumeTypesAccessTest-1817094688 None] Acquiring lock "cinder-quobyte-547fc4d6-b14d-4a09-85d6-654afdc9fa66" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:12:33 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d2939234-f057-48ff-8627-c101d7990da5 tempest-VolumeTypesAccessTest-1817094688 None] Lock "cinder-quobyte-547fc4d6-b14d-4a09-85d6-654afdc9fa66" acquired by "delete_volume" :: waited 0.018s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:12:33 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:12:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Flow 'volume_create_manager' (f5ef16e1-18ec-43ff-a04c-7d0f1dd3c1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:12:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f159023-249a-427f-8480-9227fe139d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:33 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d3430c-0791-4db1-b44f-d2ad161b7778]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:12:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d2939234-f057-48ff-8627-c101d7990da5 tempest-VolumeTypesAccessTest-1817094688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-547fc4d6-b14d-4a09-85d6-654afdc9fa66 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f159023-249a-427f-8480-9227fe139d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2070027748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64b49d08-361e-4f71-a89b-ab0292d73cae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaa9a11f2e044a499a72abe20323527f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:12:34Z,use_quota=True,user_id='fee7b8fc526346089a64545caa16874a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (511c6f53-a2b6-4efc-9d91-2395903f03c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (511c6f53-a2b6-4efc-9d91-2395903f03c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8629d154-1c91-4b97-8eeb-0e732b89444f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:33 devstack cinder-volume[87566]: DEBUG cinder.image.glance [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Creating Keystone auth plugin from conf {{(pid=87566) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 02:12:34 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-547fc4d6-b14d-4a09-85d6-654afdc9fa66 Jul 21 02:12:34 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8629d154-1c91-4b97-8eeb-0e732b89444f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '64b49d08-361e-4f71-a89b-ab0292d73cae', 'volume_name': 'volume-64b49d08-361e-4f71-a89b-ab0292d73cae', 'volume_size': 1, 'image_id': '5de785ea-426a-4934-a69a-ddf7f2aebea6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5de785ea-426a-4934-a69a-ddf7f2aebea6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a8e154f63094b778a262349ffd9723e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5de785ea-426a-4934-a69a-ddf7f2aebea6', 'created_at': datetime.datetime(2026, 7, 21, 0, 0, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 0, 0, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5de785ea-426a-4934-a69a-ddf7f2aebea6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe1eb8fd-d726-4be0-891c-790487e2fe8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe1eb8fd-d726-4be0-891c-790487e2fe8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e90c5252-fe93-4724-be3c-c1af9fc3168c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:34 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Volume 64b49d08-361e-4f71-a89b-ab0292d73cae: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-64b49d08-361e-4f71-a89b-ab0292d73cae', 'volume_size': 1, 'image_id': '5de785ea-426a-4934-a69a-ddf7f2aebea6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5de785ea-426a-4934-a69a-ddf7f2aebea6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a8e154f63094b778a262349ffd9723e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5de785ea-426a-4934-a69a-ddf7f2aebea6', 'created_at': datetime.datetime(2026, 7, 21, 0, 0, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 0, 0, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5de785ea-426a-4934-a69a-ddf7f2aebea6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 21 02:12:34 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Trying to clone 64b49d08-361e-4f71-a89b-ab0292d73cae from image 5de785ea-426a-4934-a69a-ddf7f2aebea6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5de785ea-426a-4934-a69a-ddf7f2aebea6', 'metadata': {}}]). {{(pid=87566) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 02:12:34 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d2939234-f057-48ff-8627-c101d7990da5 tempest-VolumeTypesAccessTest-1817094688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-547fc4d6-b14d-4a09-85d6-654afdc9fa66" returned: 0 in 0.455s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d2939234-f057-48ff-8627-c101d7990da5 tempest-VolumeTypesAccessTest-1817094688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-547fc4d6-b14d-4a09-85d6-654afdc9fa66 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:34 devstack sudo[95627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-547fc4d6-b14d-4a09-85d6-654afdc9fa66 Jul 21 02:12:34 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:34 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d2939234-f057-48ff-8627-c101d7990da5 tempest-VolumeTypesAccessTest-1817094688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-547fc4d6-b14d-4a09-85d6-654afdc9fa66" returned: 0 in 0.418s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:34 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d2939234-f057-48ff-8627-c101d7990da5 tempest-VolumeTypesAccessTest-1817094688 None] Lock "cinder-quobyte-547fc4d6-b14d-4a09-85d6-654afdc9fa66" released by "delete_volume" :: held 0.979s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:12:35 devstack cinder-volume[87566]: WARNING cinder.quota [None req-d2939234-f057-48ff-8627-c101d7990da5 tempest-VolumeTypesAccessTest-1817094688 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-100300844 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-100300844, it is now deprecated. Please use the default quota class for default quota. Jul 21 02:12:35 devstack cinder-volume[87566]: WARNING cinder.quota [None req-d2939234-f057-48ff-8627-c101d7990da5 tempest-VolumeTypesAccessTest-1817094688 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-100300844 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-100300844, it is now deprecated. Please use the default quota class for default quota. Jul 21 02:12:35 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_lncp3t8mdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87566) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 02:12:35 devstack cinder-volume[87566]: INFO cinder.image.image_utils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Image download 20.69 MB at 20.69 MB/s Jul 21 02:12:35 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-d2939234-f057-48ff-8627-c101d7990da5 tempest-VolumeTypesAccessTest-1817094688 None] Created reservations ['cb52817c-e6a5-47e7-8272-3e7a335023d6', '7209cae0-0e4d-4a1b-84a5-d8abc25c16bc', 'd47c69b7-af8d-42d9-8164-9d9f037c53a7', '02233998-a55e-4e6d-a0a5-184162ce3486'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:12:35 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8a4e15-f09b-43df-9c05-f03fde2770e9]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:12:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_lncp3t8mdevstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d2939234-f057-48ff-8627-c101d7990da5 tempest-VolumeTypesAccessTest-1817094688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d2939234-f057-48ff-8627-c101d7990da5 tempest-VolumeTypesAccessTest-1817094688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:35 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d2939234-f057-48ff-8627-c101d7990da5 tempest-VolumeTypesAccessTest-1817094688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:12:35 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d2939234-f057-48ff-8627-c101d7990da5 tempest-VolumeTypesAccessTest-1817094688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:12:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d2939234-f057-48ff-8627-c101d7990da5 tempest-VolumeTypesAccessTest-1817094688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d2939234-f057-48ff-8627-c101d7990da5 tempest-VolumeTypesAccessTest-1817094688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:35 devstack sudo[95633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:12:35 devstack sudo[95633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:35 devstack sudo[95632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_lncp3t8mdevstack@QuobyteHD Jul 21 02:12:35 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:35 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_lncp3t8mdevstack@QuobyteHD" returned: 0 in 0.625s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:35 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Temporary image 5de785ea-426a-4934-a69a-ddf7f2aebea6 is fetched for user fee7b8fc526346089a64545caa16874a. {{(pid=87566) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 02:12:35 devstack sudo[95633]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d2939234-f057-48ff-8627-c101d7990da5 tempest-VolumeTypesAccessTest-1817094688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.643s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:35 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-d2939234-f057-48ff-8627-c101d7990da5 tempest-VolumeTypesAccessTest-1817094688 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:12:35 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[077c0178-f47e-4a92-91b2-61ba86a79080]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:12:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_lncp3t8mdevstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:35 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-d2939234-f057-48ff-8627-c101d7990da5 tempest-VolumeTypesAccessTest-1817094688 None] Deleted volume successfully. Jul 21 02:12:35 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d2939234-f057-48ff-8627-c101d7990da5 tempest-VolumeTypesAccessTest-1817094688 None] Lock "cinder-547fc4d6-b14d-4a09-85d6-654afdc9fa66-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:12:36 devstack sudo[95656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_lncp3t8mdevstack@QuobyteHD Jul 21 02:12:36 devstack sudo[95656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:36 devstack sudo[95656]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_lncp3t8mdevstack@QuobyteHD" returned: 0 in 0.690s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:36 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2070027748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64b49d08-361e-4f71-a89b-ab0292d73cae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaa9a11f2e044a499a72abe20323527f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:12:34Z,use_quota=True,user_id='fee7b8fc526346089a64545caa16874a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:12:36 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Creating volume 64b49d08-361e-4f71-a89b-ab0292d73cae {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:12:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:36 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:12:36 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:12:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:36 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:12:36 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:12:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b49d08-361e-4f71-a89b-ab0292d73cae 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:36 devstack sudo[95701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b49d08-361e-4f71-a89b-ab0292d73cae 1073741824 Jul 21 02:12:36 devstack sudo[95701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:37 devstack sudo[95701]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b49d08-361e-4f71-a89b-ab0292d73cae 1073741824" returned: 0 in 0.873s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b49d08-361e-4f71-a89b-ab0292d73cae {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:37 devstack sudo[95747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b49d08-361e-4f71-a89b-ab0292d73cae Jul 21 02:12:37 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:37 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b49d08-361e-4f71-a89b-ab0292d73cae" returned: 0 in 0.306s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:37 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:12:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:37 devstack cinder-volume[87566]: DEBUG cinder.volume.volume_utils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Attempting download of 5de785ea-426a-4934-a69a-ddf7f2aebea6 ((None, [{'url': 'file:///opt/stack/data/glance/images/5de785ea-426a-4934-a69a-ddf7f2aebea6', 'metadata': {}}])) to volume 64b49d08-361e-4f71-a89b-ab0292d73cae. {{(pid=87566) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 02:12:37 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b10e32d-dc66-4430-88e9-41254e7a4bd5]: (4, 'raw') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:12:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5de785ea-426a-4934-a69a-ddf7f2aebea6_vn5pmk3a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:38 devstack sudo[95753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5de785ea-426a-4934-a69a-ddf7f2aebea6_vn5pmk3a Jul 21 02:12:38 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:38 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5de785ea-426a-4934-a69a-ddf7f2aebea6_vn5pmk3a" returned: 0 in 0.415s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5de785ea-426a-4934-a69a-ddf7f2aebea6_vn5pmk3a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:38 devstack sudo[95757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5de785ea-426a-4934-a69a-ddf7f2aebea6_vn5pmk3a Jul 21 02:12:38 devstack sudo[95757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:38 devstack sudo[95757]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5de785ea-426a-4934-a69a-ddf7f2aebea6_vn5pmk3a" returned: 1 in 0.473s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5de785ea-426a-4934-a69a-ddf7f2aebea6_vn5pmk3a' failed. Not Retrying. {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 02:12:38 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca854d8-9a78-4e25-a732-e14b6784492a]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:12:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_lncp3t8mdevstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:38 devstack sudo[95761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_lncp3t8mdevstack@QuobyteHD Jul 21 02:12:38 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:39 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_lncp3t8mdevstack@QuobyteHD" returned: 0 in 0.459s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:39 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] 5de785ea-426a-4934-a69a-ddf7f2aebea6 was qcow2, converting to qcow2 {{(pid=87566) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 02:12:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_lncp3t8mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b49d08-361e-4f71-a89b-ab0292d73cae {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:39 devstack sudo[95766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_lncp3t8mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b49d08-361e-4f71-a89b-ab0292d73cae Jul 21 02:12:39 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:41 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_lncp3t8mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b49d08-361e-4f71-a89b-ab0292d73cae" returned: 0 in 2.555s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:41 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_lncp3t8mdevstack@QuobyteHD, size 112.00 MB, duration 2.56 sec, destination /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b49d08-361e-4f71-a89b-ab0292d73cae {{(pid=87566) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 02:12:41 devstack cinder-volume[87566]: INFO cinder.image.image_utils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Converted 112.00 MB image at 43.81 MB/s Jul 21 02:12:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b49d08-361e-4f71-a89b-ab0292d73cae 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:41 devstack sudo[95775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b49d08-361e-4f71-a89b-ab0292d73cae 1G Jul 21 02:12:41 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:42 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b49d08-361e-4f71-a89b-ab0292d73cae 1G" returned: 0 in 0.359s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:42 devstack cinder-volume[87566]: DEBUG cinder.volume.volume_utils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Downloaded image 5de785ea-426a-4934-a69a-ddf7f2aebea6 ((None, [{'url': 'file:///opt/stack/data/glance/images/5de785ea-426a-4934-a69a-ddf7f2aebea6', 'metadata': {}}])) to volume 64b49d08-361e-4f71-a89b-ab0292d73cae successfully. {{(pid=87566) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 02:12:42 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Temporary image 5de785ea-426a-4934-a69a-ddf7f2aebea6 for user fee7b8fc526346089a64545caa16874a is deleted. {{(pid=87566) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 02:12:42 devstack cinder-volume[87566]: DEBUG cinder.volume.volume_utils [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Marking volume 64b49d08-361e-4f71-a89b-ab0292d73cae as bootable. {{(pid=87566) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 02:12:42 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Copying metadata from image 5de785ea-426a-4934-a69a-ddf7f2aebea6 to 64b49d08-361e-4f71-a89b-ab0292d73cae. {{(pid=87566) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 02:12:42 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Creating volume glance metadata for volume 64b49d08-361e-4f71-a89b-ab0292d73cae backed by image 5de785ea-426a-4934-a69a-ddf7f2aebea6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5de785ea-426a-4934-a69a-ddf7f2aebea6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87566) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 02:12:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e90c5252-fe93-4724-be3c-c1af9fc3168c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64b49d08-361e-4f71-a89b-ab0292d73cae', 'volume_size': 1, 'image_id': '5de785ea-426a-4934-a69a-ddf7f2aebea6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5de785ea-426a-4934-a69a-ddf7f2aebea6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a8e154f63094b778a262349ffd9723e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5de785ea-426a-4934-a69a-ddf7f2aebea6', 'created_at': datetime.datetime(2026, 7, 21, 0, 0, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 0, 0, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5de785ea-426a-4934-a69a-ddf7f2aebea6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055723b2-4d00-4a53-bc44-6c54d721708a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:42 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Volume volume-64b49d08-361e-4f71-a89b-ab0292d73cae (64b49d08-361e-4f71-a89b-ab0292d73cae): created successfully Jul 21 02:12:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055723b2-4d00-4a53-bc44-6c54d721708a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Flow 'volume_create_manager' (f5ef16e1-18ec-43ff-a04c-7d0f1dd3c1f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:12:42 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-7fa5df8c-6e62-4969-bf23-1963079b74d7 tempest-VolumesExtendTest-1652830309 None] Created volume successfully. Jul 21 02:12:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0be6d628-2dc6-4535-9146-9b799cf7f2a4 tempest-VolumesExtendTest-1652830309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0be6d628-2dc6-4535-9146-9b799cf7f2a4 tempest-VolumesExtendTest-1652830309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:42 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[87aa2c85-3ee9-4192-b1f8-f1e57385d882]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:12:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0be6d628-2dc6-4535-9146-9b799cf7f2a4 tempest-VolumesExtendTest-1652830309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b49d08-361e-4f71-a89b-ab0292d73cae {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:42 devstack sudo[95782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b49d08-361e-4f71-a89b-ab0292d73cae Jul 21 02:12:42 devstack sudo[95782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:43 devstack sudo[95782]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0be6d628-2dc6-4535-9146-9b799cf7f2a4 tempest-VolumesExtendTest-1652830309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b49d08-361e-4f71-a89b-ab0292d73cae" returned: 0 in 0.397s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0be6d628-2dc6-4535-9146-9b799cf7f2a4 tempest-VolumesExtendTest-1652830309 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b49d08-361e-4f71-a89b-ab0292d73cae 2G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0be6d628-2dc6-4535-9146-9b799cf7f2a4 tempest-VolumesExtendTest-1652830309 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b49d08-361e-4f71-a89b-ab0292d73cae 2G" returned: 0 in 0.112s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0be6d628-2dc6-4535-9146-9b799cf7f2a4 tempest-VolumesExtendTest-1652830309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.543s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:43 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-0be6d628-2dc6-4535-9146-9b799cf7f2a4 tempest-VolumesExtendTest-1652830309 None] Extend volume completed successfully. Jul 21 02:12:44 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3b948fd2-0b81-4366-bda9-b208c62c4ad3 tempest-VolumesExtendTest-1652830309 None] Acquiring lock "cinder-64b49d08-361e-4f71-a89b-ab0292d73cae-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:12:44 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3b948fd2-0b81-4366-bda9-b208c62c4ad3 tempest-VolumesExtendTest-1652830309 None] Lock "cinder-64b49d08-361e-4f71-a89b-ab0292d73cae-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:12:44 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3b948fd2-0b81-4366-bda9-b208c62c4ad3 tempest-VolumesExtendTest-1652830309 None] Acquiring lock "cinder-quobyte-64b49d08-361e-4f71-a89b-ab0292d73cae" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:12:44 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3b948fd2-0b81-4366-bda9-b208c62c4ad3 tempest-VolumesExtendTest-1652830309 None] Lock "cinder-quobyte-64b49d08-361e-4f71-a89b-ab0292d73cae" acquired by "delete_volume" :: waited 0.040s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:12:44 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dc4eed-1bc2-4944-b3fc-2b19fa7565f6]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:12:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3b948fd2-0b81-4366-bda9-b208c62c4ad3 tempest-VolumesExtendTest-1652830309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b49d08-361e-4f71-a89b-ab0292d73cae {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:44 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b49d08-361e-4f71-a89b-ab0292d73cae Jul 21 02:12:44 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:44 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3b948fd2-0b81-4366-bda9-b208c62c4ad3 tempest-VolumesExtendTest-1652830309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b49d08-361e-4f71-a89b-ab0292d73cae" returned: 0 in 0.454s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3b948fd2-0b81-4366-bda9-b208c62c4ad3 tempest-VolumesExtendTest-1652830309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b49d08-361e-4f71-a89b-ab0292d73cae {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:44 devstack sudo[95795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b49d08-361e-4f71-a89b-ab0292d73cae Jul 21 02:12:44 devstack sudo[95795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:45 devstack sudo[95795]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3b948fd2-0b81-4366-bda9-b208c62c4ad3 tempest-VolumesExtendTest-1652830309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b49d08-361e-4f71-a89b-ab0292d73cae" returned: 0 in 0.349s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:45 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3b948fd2-0b81-4366-bda9-b208c62c4ad3 tempest-VolumesExtendTest-1652830309 None] Lock "cinder-quobyte-64b49d08-361e-4f71-a89b-ab0292d73cae" released by "delete_volume" :: held 0.870s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:12:45 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-3b948fd2-0b81-4366-bda9-b208c62c4ad3 tempest-VolumesExtendTest-1652830309 None] Created reservations ['ab0bd136-407c-406d-8814-4a756e6c28c6', '050c2484-b2ed-4617-bc5c-8b51ba3511a2', '20965c0a-7181-4ef7-84d8-1fcd48bbbeca', 'a238c246-fba0-4f62-ad04-e73fee8a37f8'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:12:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3b948fd2-0b81-4366-bda9-b208c62c4ad3 tempest-VolumesExtendTest-1652830309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3b948fd2-0b81-4366-bda9-b208c62c4ad3 tempest-VolumesExtendTest-1652830309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:45 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-3b948fd2-0b81-4366-bda9-b208c62c4ad3 tempest-VolumesExtendTest-1652830309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:12:45 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-3b948fd2-0b81-4366-bda9-b208c62c4ad3 tempest-VolumesExtendTest-1652830309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:12:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3b948fd2-0b81-4366-bda9-b208c62c4ad3 tempest-VolumesExtendTest-1652830309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3b948fd2-0b81-4366-bda9-b208c62c4ad3 tempest-VolumesExtendTest-1652830309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:45 devstack sudo[95798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:12:45 devstack sudo[95798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:45 devstack sudo[95798]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3b948fd2-0b81-4366-bda9-b208c62c4ad3 tempest-VolumesExtendTest-1652830309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.478s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:45 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-3b948fd2-0b81-4366-bda9-b208c62c4ad3 tempest-VolumesExtendTest-1652830309 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:12:45 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-3b948fd2-0b81-4366-bda9-b208c62c4ad3 tempest-VolumesExtendTest-1652830309 None] Deleted volume successfully. Jul 21 02:12:45 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3b948fd2-0b81-4366-bda9-b208c62c4ad3 tempest-VolumesExtendTest-1652830309 None] Lock "cinder-64b49d08-361e-4f71-a89b-ab0292d73cae-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] Flow 'volume_create_manager' (e5780582-4b67-42cf-951a-737fcfdccef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (291d221a-41de-408d-9e3e-294c09cdce6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (291d221a-41de-408d-9e3e-294c09cdce6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-906147131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a9c0201-ade9-43b2-8e69-ed1519e2255e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaa9a11f2e044a499a72abe20323527f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:12:46Z,use_quota=True,user_id='fee7b8fc526346089a64545caa16874a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5687d394-9824-4408-bf2a-a1095e8d9b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5687d394-9824-4408-bf2a-a1095e8d9b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (611c7643-5e97-4e1d-8dce-125aef3a8d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (611c7643-5e97-4e1d-8dce-125aef3a8d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a9c0201-ade9-43b2-8e69-ed1519e2255e', 'volume_name': 'volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e97b2a09-59fe-419f-840c-05a7044a1122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e97b2a09-59fe-419f-840c-05a7044a1122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5b8613e-e71f-4677-8a96-924b0ad41e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:46 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] Volume 0a9c0201-ade9-43b2-8e69-ed1519e2255e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e', 'volume_size': 1} Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-906147131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a9c0201-ade9-43b2-8e69-ed1519e2255e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaa9a11f2e044a499a72abe20323527f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:12:46Z,use_quota=True,user_id='fee7b8fc526346089a64545caa16874a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] Creating volume 0a9c0201-ade9-43b2-8e69-ed1519e2255e {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:12:46 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:46 devstack sudo[95802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e 1073741824 Jul 21 02:12:46 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] Flow 'volume_create_manager' (86198384-35d2-432f-a281-c7bcb949b642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af148aea-2aca-49a3-be34-fc9a56f04ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af148aea-2aca-49a3-be34-fc9a56f04ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1830811283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28c3bde-db00-4a46-a6a5-8cabd417bf89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bb38d1b202c49cbb4156415a63152af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:12:46Z,use_quota=True,user_id='ce7680e9ee904702802f98c6233a2aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae2ad0c-0da7-4829-b0df-5ace6a62c41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae2ad0c-0da7-4829-b0df-5ace6a62c41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc019d8-c345-41be-8040-69b473c22dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc019d8-c345-41be-8040-69b473c22dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f28c3bde-db00-4a46-a6a5-8cabd417bf89', 'volume_name': 'volume-f28c3bde-db00-4a46-a6a5-8cabd417bf89', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64819054-f7d0-40ff-9d9f-85b11a93e21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64819054-f7d0-40ff-9d9f-85b11a93e21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e557d9d1-b11c-484a-ade4-ba530b04de49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:46 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] Volume f28c3bde-db00-4a46-a6a5-8cabd417bf89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f28c3bde-db00-4a46-a6a5-8cabd417bf89', 'volume_size': 1} Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:46 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e 1073741824" returned: 0 in 0.496s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:46 devstack sudo[95807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e Jul 21 02:12:46 devstack sudo[95807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:47 devstack sudo[95807]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e" returned: 0 in 0.241s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:47 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:12:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.617s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:47 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1830811283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28c3bde-db00-4a46-a6a5-8cabd417bf89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bb38d1b202c49cbb4156415a63152af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:12:46Z,use_quota=True,user_id='ce7680e9ee904702802f98c6233a2aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:12:47 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] Creating volume f28c3bde-db00-4a46-a6a5-8cabd417bf89 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:12:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:47 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:12:47 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:12:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:47 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:12:47 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:12:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f28c3bde-db00-4a46-a6a5-8cabd417bf89 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5b8613e-e71f-4677-8a96-924b0ad41e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:47 devstack sudo[95810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f28c3bde-db00-4a46-a6a5-8cabd417bf89 1073741824 Jul 21 02:12:47 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (696e8858-c83c-407b-a986-137056b67414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:47 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] Volume volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e (0a9c0201-ade9-43b2-8e69-ed1519e2255e): created successfully Jul 21 02:12:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (696e8858-c83c-407b-a986-137056b67414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] Flow 'volume_create_manager' (e5780582-4b67-42cf-951a-737fcfdccef1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:12:47 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-09591102-5d18-4a30-a5b3-143dec7120d5 tempest-VolumesExtendTest-1652830309 None] Created volume successfully. Jul 21 02:12:47 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f28c3bde-db00-4a46-a6a5-8cabd417bf89 1073741824" returned: 0 in 0.394s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f28c3bde-db00-4a46-a6a5-8cabd417bf89 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:47 devstack sudo[95815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f28c3bde-db00-4a46-a6a5-8cabd417bf89 Jul 21 02:12:47 devstack sudo[95815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:47 devstack sudo[95815]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f28c3bde-db00-4a46-a6a5-8cabd417bf89" returned: 0 in 0.253s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:47 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:12:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e557d9d1-b11c-484a-ade4-ba530b04de49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f28c3bde-db00-4a46-a6a5-8cabd417bf89', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85fe5be6-1272-42cd-b9ca-97cbbe19ec5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:47 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] Volume volume-f28c3bde-db00-4a46-a6a5-8cabd417bf89 (f28c3bde-db00-4a46-a6a5-8cabd417bf89): created successfully Jul 21 02:12:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85fe5be6-1272-42cd-b9ca-97cbbe19ec5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] Flow 'volume_create_manager' (86198384-35d2-432f-a281-c7bcb949b642) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:12:47 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-46ffc36d-58ca-4218-85d9-9b473de958a1 tempest-VolumesTransfersV355Test-602511569 None] Created volume successfully. Jul 21 02:12:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-1cafca9c-eed7-4b7b-b71a-a4c94c611b73 tempest-VolumesExtendTest-1652830309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-1cafca9c-eed7-4b7b-b71a-a4c94c611b73 tempest-VolumesExtendTest-1652830309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-1cafca9c-eed7-4b7b-b71a-a4c94c611b73 tempest-VolumesExtendTest-1652830309 None] Creating offline snapshot dbdd5cd0-8307-4add-85d1-f43c031883ad of volume 0a9c0201-ade9-43b2-8e69-ed1519e2255e {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:12:48 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d6fe52-97e7-42fa-8317-cfd30cf584a8]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:12:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1cafca9c-eed7-4b7b-b71a-a4c94c611b73 tempest-VolumesExtendTest-1652830309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:48 devstack sudo[95821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e Jul 21 02:12:48 devstack sudo[95821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:48 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:12:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] Flow 'volume_create_manager' (a344fe16-e429-49bb-b964-08abe2145b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:12:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653f594d-9b07-4134-8c13-8bc5ea9ecd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:48 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:UPDATE=102,cinder:SELECT=92,cinder:INSERT=35,cinder:DELETE=9 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:12:48 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:12:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:12:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:12:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653f594d-9b07-4134-8c13-8bc5ea9ecd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2123676387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a34d6649-de96-4501-89a3-b30ef2fb747a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba729fa0b6c945f49f04b77146c16afe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:12:49Z,use_quota=True,user_id='5810e1e223f94d54a0662920d7f4d463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be582662-7d21-493a-8dfa-61eb30015286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be582662-7d21-493a-8dfa-61eb30015286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:48 devstack sudo[95823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:12:48 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63808785-94a3-45c4-9129-fbf5c3565e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63808785-94a3-45c4-9129-fbf5c3565e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a34d6649-de96-4501-89a3-b30ef2fb747a', 'volume_name': 'volume-a34d6649-de96-4501-89a3-b30ef2fb747a', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5811c807-992b-4ea7-af10-577fae307ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5811c807-992b-4ea7-af10-577fae307ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dcc4d85-81b8-44d4-b361-224df6b3053c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:48 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] Volume a34d6649-de96-4501-89a3-b30ef2fb747a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a34d6649-de96-4501-89a3-b30ef2fb747a', 'volume_size': 1} Jul 21 02:12:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:49 devstack sudo[95821]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1cafca9c-eed7-4b7b-b71a-a4c94c611b73 tempest-VolumesExtendTest-1652830309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e" returned: 0 in 0.563s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1cafca9c-eed7-4b7b-b71a-a4c94c611b73 tempest-VolumesExtendTest-1652830309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e.dbdd5cd0-8307-4add-85d1-f43c031883ad 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:49 devstack sudo[95842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e.dbdd5cd0-8307-4add-85d1-f43c031883ad 1G Jul 21 02:12:49 devstack sudo[95842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:49 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.416s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:49 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:12:49 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager._thread_info {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:12:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread count: 28 {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 02:12:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread info: [<_MainThread(MainThread, started 135786703114368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 02:12:49 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:UPDATE=113,cinder:SELECT=96,cinder:INSERT=34,cinder:DELETE=6 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:12:49 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-0be8ffea-4944-4003-b7ad-7703b448c85d tempest-VolumesTransfersV355Test-345066408 None] Transfer volume completed successfully. Jul 21 02:12:49 devstack sudo[95842]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1cafca9c-eed7-4b7b-b71a-a4c94c611b73 tempest-VolumesExtendTest-1652830309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e.dbdd5cd0-8307-4add-85d1-f43c031883ad 1G" returned: 0 in 0.625s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1cafca9c-eed7-4b7b-b71a-a4c94c611b73 tempest-VolumesExtendTest-1652830309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e.dbdd5cd0-8307-4add-85d1-f43c031883ad {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:49 devstack sudo[95871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e.dbdd5cd0-8307-4add-85d1-f43c031883ad Jul 21 02:12:49 devstack sudo[95871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:50 devstack sudo[95871]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1cafca9c-eed7-4b7b-b71a-a4c94c611b73 tempest-VolumesExtendTest-1652830309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e.dbdd5cd0-8307-4add-85d1-f43c031883ad" returned: 0 in 0.319s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:50 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-1cafca9c-eed7-4b7b-b71a-a4c94c611b73 tempest-VolumesExtendTest-1652830309 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e.dbdd5cd0-8307-4add-85d1-f43c031883ad is being set with open permissions: ugo+rw Jul 21 02:12:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1cafca9c-eed7-4b7b-b71a-a4c94c611b73 tempest-VolumesExtendTest-1652830309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e.dbdd5cd0-8307-4add-85d1-f43c031883ad {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ef7988e4-8118-48d4-928f-ee3b1563f81f tempest-VolumesTransfersV355Test-1446564684 None] Acquiring lock "cinder-f28c3bde-db00-4a46-a6a5-8cabd417bf89-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:12:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ef7988e4-8118-48d4-928f-ee3b1563f81f tempest-VolumesTransfersV355Test-1446564684 None] Lock "cinder-f28c3bde-db00-4a46-a6a5-8cabd417bf89-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:12:50 devstack sudo[95876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e.dbdd5cd0-8307-4add-85d1-f43c031883ad Jul 21 02:12:50 devstack sudo[95876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ef7988e4-8118-48d4-928f-ee3b1563f81f tempest-VolumesTransfersV355Test-1446564684 None] Acquiring lock "cinder-quobyte-f28c3bde-db00-4a46-a6a5-8cabd417bf89" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:12:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ef7988e4-8118-48d4-928f-ee3b1563f81f tempest-VolumesTransfersV355Test-1446564684 None] Lock "cinder-quobyte-f28c3bde-db00-4a46-a6a5-8cabd417bf89" acquired by "delete_volume" :: waited 0.017s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:12:50 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[c526e30c-13e8-40ae-a23f-865c0d3c8536]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:12:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ef7988e4-8118-48d4-928f-ee3b1563f81f tempest-VolumesTransfersV355Test-1446564684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f28c3bde-db00-4a46-a6a5-8cabd417bf89 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:50 devstack sudo[95878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f28c3bde-db00-4a46-a6a5-8cabd417bf89 Jul 21 02:12:50 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:50 devstack sudo[95876]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1cafca9c-eed7-4b7b-b71a-a4c94c611b73 tempest-VolumesExtendTest-1652830309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e.dbdd5cd0-8307-4add-85d1-f43c031883ad" returned: 0 in 0.282s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1cafca9c-eed7-4b7b-b71a-a4c94c611b73 tempest-VolumesExtendTest-1652830309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:50 devstack sudo[95882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e.info Jul 21 02:12:50 devstack sudo[95882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:50 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ef7988e4-8118-48d4-928f-ee3b1563f81f tempest-VolumesTransfersV355Test-1446564684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f28c3bde-db00-4a46-a6a5-8cabd417bf89" returned: 0 in 0.405s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ef7988e4-8118-48d4-928f-ee3b1563f81f tempest-VolumesTransfersV355Test-1446564684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f28c3bde-db00-4a46-a6a5-8cabd417bf89 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:50 devstack sudo[95905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f28c3bde-db00-4a46-a6a5-8cabd417bf89 Jul 21 02:12:50 devstack sudo[95905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:50 devstack sudo[95882]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1cafca9c-eed7-4b7b-b71a-a4c94c611b73 tempest-VolumesExtendTest-1652830309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e.info" returned: 0 in 0.293s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:50 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-1cafca9c-eed7-4b7b-b71a-a4c94c611b73 tempest-VolumesExtendTest-1652830309 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e.info is being set with open permissions: ugo+rw Jul 21 02:12:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1cafca9c-eed7-4b7b-b71a-a4c94c611b73 tempest-VolumesExtendTest-1652830309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:50 devstack sudo[95907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e.info Jul 21 02:12:50 devstack sudo[95907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:50 devstack sudo[95905]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ef7988e4-8118-48d4-928f-ee3b1563f81f tempest-VolumesTransfersV355Test-1446564684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f28c3bde-db00-4a46-a6a5-8cabd417bf89" returned: 0 in 0.302s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ef7988e4-8118-48d4-928f-ee3b1563f81f tempest-VolumesTransfersV355Test-1446564684 None] Lock "cinder-quobyte-f28c3bde-db00-4a46-a6a5-8cabd417bf89" released by "delete_volume" :: held 0.745s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:12:50 devstack sudo[95907]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:50 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-ef7988e4-8118-48d4-928f-ee3b1563f81f tempest-VolumesTransfersV355Test-1446564684 None] Created reservations ['690fd94d-81ea-43b7-9e2a-045d42fd378c', 'f21c572e-7f80-4830-b7dd-2e2c6ed621a5', 'd03b2a1f-0931-4d6a-8c92-64b55e15e6d7', '2f70d60f-7c56-4e80-ac6a-e62e798fce1e'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:12:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1cafca9c-eed7-4b7b-b71a-a4c94c611b73 tempest-VolumesExtendTest-1652830309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e.info" returned: 0 in 0.297s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-1cafca9c-eed7-4b7b-b71a-a4c94c611b73 tempest-VolumesExtendTest-1652830309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.518s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.045s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2123676387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a34d6649-de96-4501-89a3-b30ef2fb747a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba729fa0b6c945f49f04b77146c16afe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:12:49Z,use_quota=True,user_id='5810e1e223f94d54a0662920d7f4d463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:12:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] Creating volume a34d6649-de96-4501-89a3-b30ef2fb747a {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:12:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:12:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:12:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:12:50 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:12:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a34d6649-de96-4501-89a3-b30ef2fb747a 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:51 devstack sudo[95911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a34d6649-de96-4501-89a3-b30ef2fb747a 1073741824 Jul 21 02:12:51 devstack sudo[95911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:51 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-1cafca9c-eed7-4b7b-b71a-a4c94c611b73 tempest-VolumesExtendTest-1652830309 None] Create snapshot completed successfully Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ef7988e4-8118-48d4-928f-ee3b1563f81f tempest-VolumesTransfersV355Test-1446564684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ef7988e4-8118-48d4-928f-ee3b1563f81f tempest-VolumesTransfersV355Test-1446564684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ef7988e4-8118-48d4-928f-ee3b1563f81f tempest-VolumesTransfersV355Test-1446564684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ef7988e4-8118-48d4-928f-ee3b1563f81f tempest-VolumesTransfersV355Test-1446564684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ef7988e4-8118-48d4-928f-ee3b1563f81f tempest-VolumesTransfersV355Test-1446564684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ef7988e4-8118-48d4-928f-ee3b1563f81f tempest-VolumesTransfersV355Test-1446564684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:51 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:12:51 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:51 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ef7988e4-8118-48d4-928f-ee3b1563f81f tempest-VolumesTransfersV355Test-1446564684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.282s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-ef7988e4-8118-48d4-928f-ee3b1563f81f tempest-VolumesTransfersV355Test-1446564684 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:12:51 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-ef7988e4-8118-48d4-928f-ee3b1563f81f tempest-VolumesTransfersV355Test-1446564684 None] Deleted volume successfully. Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ef7988e4-8118-48d4-928f-ee3b1563f81f tempest-VolumesTransfersV355Test-1446564684 None] Lock "cinder-f28c3bde-db00-4a46-a6a5-8cabd417bf89-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:12:51 devstack sudo[95911]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a34d6649-de96-4501-89a3-b30ef2fb747a 1073741824" returned: 0 in 0.434s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a34d6649-de96-4501-89a3-b30ef2fb747a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:51 devstack sudo[95920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a34d6649-de96-4501-89a3-b30ef2fb747a Jul 21 02:12:51 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:51 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a34d6649-de96-4501-89a3-b30ef2fb747a" returned: 0 in 0.265s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dcc4d85-81b8-44d4-b361-224df6b3053c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a34d6649-de96-4501-89a3-b30ef2fb747a', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5fa4264-f300-4539-94cc-766c2a861e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:51 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] Volume volume-a34d6649-de96-4501-89a3-b30ef2fb747a (a34d6649-de96-4501-89a3-b30ef2fb747a): created successfully Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5fa4264-f300-4539-94cc-766c2a861e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] Flow 'volume_create_manager' (a344fe16-e429-49bb-b964-08abe2145b7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:12:51 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-a3558f42-f85d-4a69-9b91-592c56bcf1b6 tempest-AttachVolumeNegativeTest-1066125899 None] Created volume successfully. Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-968732aa-191a-4928-a3b6-a33f3eb7255c tempest-VolumesExtendTest-1652830309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-968732aa-191a-4928-a3b6-a33f3eb7255c tempest-VolumesExtendTest-1652830309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee696c5-3fa5-4151-a8d5-c26ed25a5da4]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-968732aa-191a-4928-a3b6-a33f3eb7255c tempest-VolumesExtendTest-1652830309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] Flow 'volume_create_manager' (726c4d2c-80eb-4228-8a28-948c62057b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae52c56-0703-4a96-878b-2bc17a064bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae52c56-0703-4a96-878b-2bc17a064bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1705165455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adf0bb23-369b-4e89-8a3e-8dd27be8973b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bb38d1b202c49cbb4156415a63152af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:12:52Z,use_quota=True,user_id='ce7680e9ee904702802f98c6233a2aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ce0cbe9-d28b-4688-8b33-96b9e285c1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ce0cbe9-d28b-4688-8b33-96b9e285c1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad0bc860-da7c-4b2b-8da5-6ad467a3b0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad0bc860-da7c-4b2b-8da5-6ad467a3b0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adf0bb23-369b-4e89-8a3e-8dd27be8973b', 'volume_name': 'volume-adf0bb23-369b-4e89-8a3e-8dd27be8973b', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0262b1c-4c68-4c81-8705-34be317dd0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0262b1c-4c68-4c81-8705-34be317dd0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:51 devstack sudo[95923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e Jul 21 02:12:51 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f88abf92-b731-4505-837f-1419ea9c4d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:51 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] Volume adf0bb23-369b-4e89-8a3e-8dd27be8973b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adf0bb23-369b-4e89-8a3e-8dd27be8973b', 'volume_size': 1} Jul 21 02:12:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:52 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-968732aa-191a-4928-a3b6-a33f3eb7255c tempest-VolumesExtendTest-1652830309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e" returned: 0 in 0.400s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-968732aa-191a-4928-a3b6-a33f3eb7255c tempest-VolumesExtendTest-1652830309 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e.dbdd5cd0-8307-4add-85d1-f43c031883ad 2G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-968732aa-191a-4928-a3b6-a33f3eb7255c tempest-VolumesExtendTest-1652830309 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e.dbdd5cd0-8307-4add-85d1-f43c031883ad 2G" returned: 0 in 0.125s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-968732aa-191a-4928-a3b6-a33f3eb7255c tempest-VolumesExtendTest-1652830309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.559s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.428s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:52 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1705165455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adf0bb23-369b-4e89-8a3e-8dd27be8973b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bb38d1b202c49cbb4156415a63152af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:12:52Z,use_quota=True,user_id='ce7680e9ee904702802f98c6233a2aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:12:52 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] Creating volume adf0bb23-369b-4e89-8a3e-8dd27be8973b {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:12:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:52 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:12:52 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:12:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:52 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:12:52 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:12:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-adf0bb23-369b-4e89-8a3e-8dd27be8973b 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:52 devstack sudo[95937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-adf0bb23-369b-4e89-8a3e-8dd27be8973b 1073741824 Jul 21 02:12:52 devstack sudo[95937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:52 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-968732aa-191a-4928-a3b6-a33f3eb7255c tempest-VolumesExtendTest-1652830309 None] Extend volume completed successfully. Jul 21 02:12:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-6296c9c8-fbc1-4b84-a625-38205bb76253 req-3c3647eb-7a04-4268-9e06-6762b94a6e0c tempest-AttachVolumeNegativeTest-1066125899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:52 devstack sudo[95937]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-adf0bb23-369b-4e89-8a3e-8dd27be8973b 1073741824" returned: 0 in 0.477s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-adf0bb23-369b-4e89-8a3e-8dd27be8973b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:52 devstack sudo[95952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-adf0bb23-369b-4e89-8a3e-8dd27be8973b Jul 21 02:12:52 devstack sudo[95952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:52 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-7f096f14-8fb7-42b7-87ab-626d1407fd43 tempest-VolumesExtendTest-1652830309 None] Acquiring lock "cinder-dbdd5cd0-8307-4add-85d1-f43c031883ad-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:12:53 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-7f096f14-8fb7-42b7-87ab-626d1407fd43 tempest-VolumesExtendTest-1652830309 None] Lock "cinder-dbdd5cd0-8307-4add-85d1-f43c031883ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:12:53 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-7f096f14-8fb7-42b7-87ab-626d1407fd43 tempest-VolumesExtendTest-1652830309 None] Acquiring lock "cinder-quobyte-0a9c0201-ade9-43b2-8e69-ed1519e2255e" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:12:53 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-7f096f14-8fb7-42b7-87ab-626d1407fd43 tempest-VolumesExtendTest-1652830309 None] Lock "cinder-quobyte-0a9c0201-ade9-43b2-8e69-ed1519e2255e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:12:53 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-7f096f14-8fb7-42b7-87ab-626d1407fd43 tempest-VolumesExtendTest-1652830309 None] Acquiring lock "cinder-quobyte-dbdd5cd0-8307-4add-85d1-f43c031883ad" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:12:53 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-7f096f14-8fb7-42b7-87ab-626d1407fd43 tempest-VolumesExtendTest-1652830309 None] Lock "cinder-quobyte-dbdd5cd0-8307-4add-85d1-f43c031883ad" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:12:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-7f096f14-8fb7-42b7-87ab-626d1407fd43 tempest-VolumesExtendTest-1652830309 None] Deleting offline snapshot dbdd5cd0-8307-4add-85d1-f43c031883ad of volume 0a9c0201-ade9-43b2-8e69-ed1519e2255e {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:12:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-7f096f14-8fb7-42b7-87ab-626d1407fd43 tempest-VolumesExtendTest-1652830309 None] snapshot_file for this snap is: volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e.dbdd5cd0-8307-4add-85d1-f43c031883ad {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:12:53 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90d76fe-05d1-4d27-a121-2d7fec579b58]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:12:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7f096f14-8fb7-42b7-87ab-626d1407fd43 tempest-VolumesExtendTest-1652830309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e.dbdd5cd0-8307-4add-85d1-f43c031883ad {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:53 devstack sudo[95952]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-adf0bb23-369b-4e89-8a3e-8dd27be8973b" returned: 0 in 0.257s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:12:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-6296c9c8-fbc1-4b84-a625-38205bb76253 req-3c3647eb-7a04-4268-9e06-6762b94a6e0c tempest-AttachVolumeNegativeTest-1066125899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.328s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:53 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f88abf92-b731-4505-837f-1419ea9c4d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adf0bb23-369b-4e89-8a3e-8dd27be8973b', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:53 devstack sudo[95954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e.dbdd5cd0-8307-4add-85d1-f43c031883ad Jul 21 02:12:53 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:53 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33da99d2-28f5-4423-819d-4081bbc903df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:12:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-6296c9c8-fbc1-4b84-a625-38205bb76253 req-3c3647eb-7a04-4268-9e06-6762b94a6e0c tempest-AttachVolumeNegativeTest-1066125899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:53 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] Volume volume-adf0bb23-369b-4e89-8a3e-8dd27be8973b (adf0bb23-369b-4e89-8a3e-8dd27be8973b): created successfully Jul 21 02:12:53 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33da99d2-28f5-4423-819d-4081bbc903df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:12:53 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] Flow 'volume_create_manager' (726c4d2c-80eb-4228-8a28-948c62057b0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:12:53 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-f0b9cace-506a-4e85-a15e-9935c5629b43 tempest-VolumesTransfersV355Test-602511569 None] Created volume successfully. Jul 21 02:12:53 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-6296c9c8-fbc1-4b84-a625-38205bb76253 req-3c3647eb-7a04-4268-9e06-6762b94a6e0c tempest-AttachVolumeNegativeTest-1066125899 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea', 'name': 'volume-a34d6649-de96-4501-89a3-b30ef2fb747a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '86ca7401-1f84-4510-a0a3-006b2ac0f54e', 'enforce_multipath': True} {{(pid=87566) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 02:12:53 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-6296c9c8-fbc1-4b84-a625-38205bb76253 req-3c3647eb-7a04-4268-9e06-6762b94a6e0c tempest-AttachVolumeNegativeTest-1066125899 None] attachment_update completed successfully. Jul 21 02:12:53 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7f096f14-8fb7-42b7-87ab-626d1407fd43 tempest-VolumesExtendTest-1652830309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e.dbdd5cd0-8307-4add-85d1-f43c031883ad" returned: 0 in 0.372s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-7f096f14-8fb7-42b7-87ab-626d1407fd43 tempest-VolumesExtendTest-1652830309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:12:53 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba06b0d4-f116-4165-84f3-4de20952064f]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:12:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7f096f14-8fb7-42b7-87ab-626d1407fd43 tempest-VolumesExtendTest-1652830309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:53 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e Jul 21 02:12:53 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:53 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7f096f14-8fb7-42b7-87ab-626d1407fd43 tempest-VolumesExtendTest-1652830309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e" returned: 0 in 0.455s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7f096f14-8fb7-42b7-87ab-626d1407fd43 tempest-VolumesExtendTest-1652830309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e.dbdd5cd0-8307-4add-85d1-f43c031883ad {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:53 devstack sudo[96348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e.dbdd5cd0-8307-4add-85d1-f43c031883ad Jul 21 02:12:53 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8ec16dfd-786a-4596-8e85-498ba7b77ac0 tempest-VolumesTransfersV355Test-1446564684 None] Acquiring lock "cinder-adf0bb23-369b-4e89-8a3e-8dd27be8973b-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:12:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8ec16dfd-786a-4596-8e85-498ba7b77ac0 tempest-VolumesTransfersV355Test-1446564684 None] Lock "cinder-adf0bb23-369b-4e89-8a3e-8dd27be8973b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:12:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8ec16dfd-786a-4596-8e85-498ba7b77ac0 tempest-VolumesTransfersV355Test-1446564684 None] Acquiring lock "cinder-quobyte-adf0bb23-369b-4e89-8a3e-8dd27be8973b" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:12:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8ec16dfd-786a-4596-8e85-498ba7b77ac0 tempest-VolumesTransfersV355Test-1446564684 None] Lock "cinder-quobyte-adf0bb23-369b-4e89-8a3e-8dd27be8973b" acquired by "delete_volume" :: waited 0.016s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:12:54 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[106d1c0f-8cb4-4cfb-ad33-fe96d07f6114]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:12:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8ec16dfd-786a-4596-8e85-498ba7b77ac0 tempest-VolumesTransfersV355Test-1446564684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-adf0bb23-369b-4e89-8a3e-8dd27be8973b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:54 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7f096f14-8fb7-42b7-87ab-626d1407fd43 tempest-VolumesExtendTest-1652830309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e.dbdd5cd0-8307-4add-85d1-f43c031883ad" returned: 0 in 0.458s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7f096f14-8fb7-42b7-87ab-626d1407fd43 tempest-VolumesExtendTest-1652830309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e.dbdd5cd0-8307-4add-85d1-f43c031883ad {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:54 devstack sudo[96355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e.dbdd5cd0-8307-4add-85d1-f43c031883ad Jul 21 02:12:54 devstack sudo[96355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:54 devstack sudo[96354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-adf0bb23-369b-4e89-8a3e-8dd27be8973b Jul 21 02:12:54 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:54 devstack sudo[96355]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7f096f14-8fb7-42b7-87ab-626d1407fd43 tempest-VolumesExtendTest-1652830309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e.dbdd5cd0-8307-4add-85d1-f43c031883ad" returned: 0 in 0.250s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-7f096f14-8fb7-42b7-87ab-626d1407fd43 tempest-VolumesExtendTest-1652830309 None] Lock "cinder-quobyte-dbdd5cd0-8307-4add-85d1-f43c031883ad" released by "_delete_snapshot" :: held 1.649s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:12:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-7f096f14-8fb7-42b7-87ab-626d1407fd43 tempest-VolumesExtendTest-1652830309 None] Lock "cinder-quobyte-0a9c0201-ade9-43b2-8e69-ed1519e2255e" released by "delete_snapshot" :: held 1.674s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:12:54 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8ec16dfd-786a-4596-8e85-498ba7b77ac0 tempest-VolumesTransfersV355Test-1446564684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-adf0bb23-369b-4e89-8a3e-8dd27be8973b" returned: 0 in 0.373s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8ec16dfd-786a-4596-8e85-498ba7b77ac0 tempest-VolumesTransfersV355Test-1446564684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-adf0bb23-369b-4e89-8a3e-8dd27be8973b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:54 devstack sudo[96362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-adf0bb23-369b-4e89-8a3e-8dd27be8973b Jul 21 02:12:54 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:54 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-7f096f14-8fb7-42b7-87ab-626d1407fd43 tempest-VolumesExtendTest-1652830309 None] Created reservations ['3bc771a0-ac93-4960-8747-8962218ecc8b', '3648eea5-84c5-4cde-a00d-45a3746d2008', '1e4f6da9-01a8-4ef7-81b8-abbeb7b3c2f4', '654aa518-eb6b-467e-a085-827b5d6e231e'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:12:54 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-7f096f14-8fb7-42b7-87ab-626d1407fd43 tempest-VolumesExtendTest-1652830309 None] Delete snapshot completed successfully. Jul 21 02:12:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-7f096f14-8fb7-42b7-87ab-626d1407fd43 tempest-VolumesExtendTest-1652830309 None] Lock "cinder-dbdd5cd0-8307-4add-85d1-f43c031883ad-delete_snapshot" released by "delete_snapshot" :: held 1.853s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:12:54 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8ec16dfd-786a-4596-8e85-498ba7b77ac0 tempest-VolumesTransfersV355Test-1446564684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-adf0bb23-369b-4e89-8a3e-8dd27be8973b" returned: 0 in 0.279s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:55 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8ec16dfd-786a-4596-8e85-498ba7b77ac0 tempest-VolumesTransfersV355Test-1446564684 None] Lock "cinder-quobyte-adf0bb23-369b-4e89-8a3e-8dd27be8973b" released by "delete_volume" :: held 0.689s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:12:55 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-8ec16dfd-786a-4596-8e85-498ba7b77ac0 tempest-VolumesTransfersV355Test-1446564684 None] Created reservations ['6f8bf9f6-58fe-4984-826e-ab968e94d546', 'c977addb-e307-4d5a-8bba-8e3b9872c183', 'ee383cd7-62d5-460c-bcaf-f96284ccebfd', '2b9646d0-88ae-487a-abab-566651ed50c6'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:12:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8ec16dfd-786a-4596-8e85-498ba7b77ac0 tempest-VolumesTransfersV355Test-1446564684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8ec16dfd-786a-4596-8e85-498ba7b77ac0 tempest-VolumesTransfersV355Test-1446564684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8ec16dfd-786a-4596-8e85-498ba7b77ac0 tempest-VolumesTransfersV355Test-1446564684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:12:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8ec16dfd-786a-4596-8e85-498ba7b77ac0 tempest-VolumesTransfersV355Test-1446564684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:12:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8ec16dfd-786a-4596-8e85-498ba7b77ac0 tempest-VolumesTransfersV355Test-1446564684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8ec16dfd-786a-4596-8e85-498ba7b77ac0 tempest-VolumesTransfersV355Test-1446564684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:55 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:12:55 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:55 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-88ace5f8-935b-4c54-8d95-0fe1ce1aaa8a tempest-VolumesExtendTest-1652830309 None] Acquiring lock "cinder-0a9c0201-ade9-43b2-8e69-ed1519e2255e-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:12:55 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-88ace5f8-935b-4c54-8d95-0fe1ce1aaa8a tempest-VolumesExtendTest-1652830309 None] Lock "cinder-0a9c0201-ade9-43b2-8e69-ed1519e2255e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:12:55 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-88ace5f8-935b-4c54-8d95-0fe1ce1aaa8a tempest-VolumesExtendTest-1652830309 None] Acquiring lock "cinder-quobyte-0a9c0201-ade9-43b2-8e69-ed1519e2255e" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:12:55 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-88ace5f8-935b-4c54-8d95-0fe1ce1aaa8a tempest-VolumesExtendTest-1652830309 None] Lock "cinder-quobyte-0a9c0201-ade9-43b2-8e69-ed1519e2255e" acquired by "delete_volume" :: waited 0.021s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:12:55 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8706fb-9dce-47b3-a5be-0ac98ac87cd8]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:12:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-88ace5f8-935b-4c54-8d95-0fe1ce1aaa8a tempest-VolumesExtendTest-1652830309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:55 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8ec16dfd-786a-4596-8e85-498ba7b77ac0 tempest-VolumesTransfersV355Test-1446564684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.364s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:55 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-8ec16dfd-786a-4596-8e85-498ba7b77ac0 tempest-VolumesTransfersV355Test-1446564684 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:12:55 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-8ec16dfd-786a-4596-8e85-498ba7b77ac0 tempest-VolumesTransfersV355Test-1446564684 None] Deleted volume successfully. Jul 21 02:12:55 devstack sudo[96368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e Jul 21 02:12:55 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:55 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8ec16dfd-786a-4596-8e85-498ba7b77ac0 tempest-VolumesTransfersV355Test-1446564684 None] Lock "cinder-adf0bb23-369b-4e89-8a3e-8dd27be8973b-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:12:55 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-55704564-ba2f-47a5-b734-5ad9976fc55f req-dff4ebd4-b69b-4321-982e-5dea16997cf7 tempest-AttachVolumeNegativeTest-1066125899 None] Terminate volume connection completed successfully. Jul 21 02:12:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-55704564-ba2f-47a5-b734-5ad9976fc55f req-dff4ebd4-b69b-4321-982e-5dea16997cf7 tempest-AttachVolumeNegativeTest-1066125899 None] Deleting attachment 86ca7401-1f84-4510-a0a3-006b2ac0f54e. {{(pid=87566) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 02:12:55 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-88ace5f8-935b-4c54-8d95-0fe1ce1aaa8a tempest-VolumesExtendTest-1652830309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e" returned: 0 in 0.443s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-88ace5f8-935b-4c54-8d95-0fe1ce1aaa8a tempest-VolumesExtendTest-1652830309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:55 devstack sudo[96400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e Jul 21 02:12:55 devstack sudo[96400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:56 devstack sudo[96400]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-88ace5f8-935b-4c54-8d95-0fe1ce1aaa8a tempest-VolumesExtendTest-1652830309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a9c0201-ade9-43b2-8e69-ed1519e2255e" returned: 0 in 0.260s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:56 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-88ace5f8-935b-4c54-8d95-0fe1ce1aaa8a tempest-VolumesExtendTest-1652830309 None] Lock "cinder-quobyte-0a9c0201-ade9-43b2-8e69-ed1519e2255e" released by "delete_volume" :: held 0.782s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:12:56 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-88ace5f8-935b-4c54-8d95-0fe1ce1aaa8a tempest-VolumesExtendTest-1652830309 None] Created reservations ['8070b21c-35ec-4c3c-a6a5-638776afedd0', 'd376f0d5-ed20-4ff7-b466-91deb67ff955', 'dd391799-3392-426b-ae77-7d2e4fc73456', '2aaa1f66-941c-4f76-a751-3f267e8f4fb7'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:12:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-88ace5f8-935b-4c54-8d95-0fe1ce1aaa8a tempest-VolumesExtendTest-1652830309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:12:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-88ace5f8-935b-4c54-8d95-0fe1ce1aaa8a tempest-VolumesExtendTest-1652830309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:12:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-88ace5f8-935b-4c54-8d95-0fe1ce1aaa8a tempest-VolumesExtendTest-1652830309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:12:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-88ace5f8-935b-4c54-8d95-0fe1ce1aaa8a tempest-VolumesExtendTest-1652830309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:12:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-88ace5f8-935b-4c54-8d95-0fe1ce1aaa8a tempest-VolumesExtendTest-1652830309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:12:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-88ace5f8-935b-4c54-8d95-0fe1ce1aaa8a tempest-VolumesExtendTest-1652830309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:12:56 devstack sudo[96403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:12:56 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:12:56 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root Jul 21 02:12:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-88ace5f8-935b-4c54-8d95-0fe1ce1aaa8a tempest-VolumesExtendTest-1652830309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.339s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:12:56 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-88ace5f8-935b-4c54-8d95-0fe1ce1aaa8a tempest-VolumesExtendTest-1652830309 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:12:56 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-88ace5f8-935b-4c54-8d95-0fe1ce1aaa8a tempest-VolumesExtendTest-1652830309 None] Deleted volume successfully. Jul 21 02:12:56 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-88ace5f8-935b-4c54-8d95-0fe1ce1aaa8a tempest-VolumesExtendTest-1652830309 None] Lock "cinder-0a9c0201-ade9-43b2-8e69-ed1519e2255e-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3332b97e-4573-43cf-9b9e-a6bfdc643a1c tempest-AttachVolumeNegativeTest-1066125899 None] Acquiring lock "cinder-a34d6649-de96-4501-89a3-b30ef2fb747a-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3332b97e-4573-43cf-9b9e-a6bfdc643a1c tempest-AttachVolumeNegativeTest-1066125899 None] Lock "cinder-a34d6649-de96-4501-89a3-b30ef2fb747a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3332b97e-4573-43cf-9b9e-a6bfdc643a1c tempest-AttachVolumeNegativeTest-1066125899 None] Acquiring lock "cinder-quobyte-a34d6649-de96-4501-89a3-b30ef2fb747a" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3332b97e-4573-43cf-9b9e-a6bfdc643a1c tempest-AttachVolumeNegativeTest-1066125899 None] Lock "cinder-quobyte-a34d6649-de96-4501-89a3-b30ef2fb747a" acquired by "delete_volume" :: waited 0.020s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:01 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f249bc-91e8-49f7-8c0e-eac146662843]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:13:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3332b97e-4573-43cf-9b9e-a6bfdc643a1c tempest-AttachVolumeNegativeTest-1066125899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a34d6649-de96-4501-89a3-b30ef2fb747a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:01 devstack sudo[96429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a34d6649-de96-4501-89a3-b30ef2fb747a Jul 21 02:13:01 devstack sudo[96429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:01 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:13:01 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] Flow 'volume_create_manager' (7382707a-d2a6-43bb-904e-955e0574e128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:13:01 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49acbf2e-5140-4ff4-a6d4-f8b3929e439b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:01 devstack sudo[96429]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:01 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49acbf2e-5140-4ff4-a6d4-f8b3929e439b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-50255871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9feecfbe-13da-4d19-b2e8-351d5d728176,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='59682f03e56f442a95b488e6ada71d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:13:02Z,use_quota=True,user_id='4b359d60f98340a3a412c9a72404c995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:01 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da049a9-4798-4446-9bea-a6ba14c60fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:01 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da049a9-4798-4446-9bea-a6ba14c60fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:01 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad529dae-bb6c-46ad-9eaa-61a69fdf2db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:01 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad529dae-bb6c-46ad-9eaa-61a69fdf2db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9feecfbe-13da-4d19-b2e8-351d5d728176', 'volume_name': 'volume-9feecfbe-13da-4d19-b2e8-351d5d728176', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:01 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d800c88-c95d-4a28-aa97-c1ff28a5dd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:01 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d800c88-c95d-4a28-aa97-c1ff28a5dd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:01 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d61961f-274d-46f0-96a9-2da8a259ff3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:01 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] Volume 9feecfbe-13da-4d19-b2e8-351d5d728176: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9feecfbe-13da-4d19-b2e8-351d5d728176', 'volume_size': 1} Jul 21 02:13:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:01 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-50255871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9feecfbe-13da-4d19-b2e8-351d5d728176,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='59682f03e56f442a95b488e6ada71d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:13:02Z,use_quota=True,user_id='4b359d60f98340a3a412c9a72404c995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:13:01 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] Creating volume 9feecfbe-13da-4d19-b2e8-351d5d728176 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:13:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:01 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:13:01 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:13:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:01 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:13:01 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:13:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9feecfbe-13da-4d19-b2e8-351d5d728176 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3332b97e-4573-43cf-9b9e-a6bfdc643a1c tempest-AttachVolumeNegativeTest-1066125899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a34d6649-de96-4501-89a3-b30ef2fb747a" returned: 0 in 0.580s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3332b97e-4573-43cf-9b9e-a6bfdc643a1c tempest-AttachVolumeNegativeTest-1066125899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a34d6649-de96-4501-89a3-b30ef2fb747a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:01 devstack sudo[96434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9feecfbe-13da-4d19-b2e8-351d5d728176 1073741824 Jul 21 02:13:01 devstack sudo[96434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:02 devstack sudo[96435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a34d6649-de96-4501-89a3-b30ef2fb747a Jul 21 02:13:02 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:02 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3332b97e-4573-43cf-9b9e-a6bfdc643a1c tempest-AttachVolumeNegativeTest-1066125899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a34d6649-de96-4501-89a3-b30ef2fb747a" returned: 0 in 0.268s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:02 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3332b97e-4573-43cf-9b9e-a6bfdc643a1c tempest-AttachVolumeNegativeTest-1066125899 None] Lock "cinder-quobyte-a34d6649-de96-4501-89a3-b30ef2fb747a" released by "delete_volume" :: held 0.912s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:02 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-3332b97e-4573-43cf-9b9e-a6bfdc643a1c tempest-AttachVolumeNegativeTest-1066125899 None] Created reservations ['4d8a1c50-db99-48ab-8e17-365afe8a6276', 'e61b4291-22ed-4b8b-a061-7469ca064c92', 'dbe9cbcf-83f8-479c-82b7-36923bd99586', '7581dd27-c137-497f-90f8-e6a7b835e31c'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:13:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3332b97e-4573-43cf-9b9e-a6bfdc643a1c tempest-AttachVolumeNegativeTest-1066125899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3332b97e-4573-43cf-9b9e-a6bfdc643a1c tempest-AttachVolumeNegativeTest-1066125899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:02 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-3332b97e-4573-43cf-9b9e-a6bfdc643a1c tempest-AttachVolumeNegativeTest-1066125899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:13:02 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-3332b97e-4573-43cf-9b9e-a6bfdc643a1c tempest-AttachVolumeNegativeTest-1066125899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:13:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3332b97e-4573-43cf-9b9e-a6bfdc643a1c tempest-AttachVolumeNegativeTest-1066125899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3332b97e-4573-43cf-9b9e-a6bfdc643a1c tempest-AttachVolumeNegativeTest-1066125899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:02 devstack sudo[96444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:13:02 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:02 devstack sudo[96434]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9feecfbe-13da-4d19-b2e8-351d5d728176 1073741824" returned: 0 in 0.515s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9feecfbe-13da-4d19-b2e8-351d5d728176 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:02 devstack sudo[96446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9feecfbe-13da-4d19-b2e8-351d5d728176 Jul 21 02:13:02 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:02 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3332b97e-4573-43cf-9b9e-a6bfdc643a1c tempest-AttachVolumeNegativeTest-1066125899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.261s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:02 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-3332b97e-4573-43cf-9b9e-a6bfdc643a1c tempest-AttachVolumeNegativeTest-1066125899 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:13:02 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-3332b97e-4573-43cf-9b9e-a6bfdc643a1c tempest-AttachVolumeNegativeTest-1066125899 None] Deleted volume successfully. Jul 21 02:13:02 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3332b97e-4573-43cf-9b9e-a6bfdc643a1c tempest-AttachVolumeNegativeTest-1066125899 None] Lock "cinder-a34d6649-de96-4501-89a3-b30ef2fb747a-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:02 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9feecfbe-13da-4d19-b2e8-351d5d728176" returned: 0 in 0.271s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:02 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:13:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:02 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d61961f-274d-46f0-96a9-2da8a259ff3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9feecfbe-13da-4d19-b2e8-351d5d728176', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:02 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b710c1a-9c9e-495f-b392-84d157c58911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:02 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] Volume volume-9feecfbe-13da-4d19-b2e8-351d5d728176 (9feecfbe-13da-4d19-b2e8-351d5d728176): created successfully Jul 21 02:13:02 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b710c1a-9c9e-495f-b392-84d157c58911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:02 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] Flow 'volume_create_manager' (7382707a-d2a6-43bb-904e-955e0574e128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:13:02 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-c82f646d-ff90-43bf-ae8f-dac48258131c tempest-VolumesGetTest-1773935590 None] Created volume successfully. Jul 21 02:13:03 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:13:03 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] Flow 'volume_create_manager' (e17c79ab-38d8-47a1-a010-90e06c6a1e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:13:03 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3463c84-c06a-4b66-a250-a9988e76e839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:03 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3463c84-c06a-4b66-a250-a9988e76e839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1926710462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbbfd14f-7de3-4273-9f9b-0a4946c11a25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d940d7c2f514f48ae1ed331d1e36db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:13:03Z,use_quota=True,user_id='918e8541ec7742d2b22e778a1643bed9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:03 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a54fb36a-dcc1-4b0a-881b-5d1bc4bd642e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:03 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a54fb36a-dcc1-4b0a-881b-5d1bc4bd642e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:03 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b3e64c-a660-4d80-8a1d-9e6e136d6858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:03 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b3e64c-a660-4d80-8a1d-9e6e136d6858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbbfd14f-7de3-4273-9f9b-0a4946c11a25', 'volume_name': 'volume-bbbfd14f-7de3-4273-9f9b-0a4946c11a25', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:03 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (008d2a84-d39e-4640-8f06-5235e52116b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:03 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (008d2a84-d39e-4640-8f06-5235e52116b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:03 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d831c44-8ea4-4f76-a991-4e0549de6d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:03 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] Volume bbbfd14f-7de3-4273-9f9b-0a4946c11a25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbbfd14f-7de3-4273-9f9b-0a4946c11a25', 'volume_size': 1} Jul 21 02:13:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:03 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1926710462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbbfd14f-7de3-4273-9f9b-0a4946c11a25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d940d7c2f514f48ae1ed331d1e36db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:13:03Z,use_quota=True,user_id='918e8541ec7742d2b22e778a1643bed9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:13:03 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] Creating volume bbbfd14f-7de3-4273-9f9b-0a4946c11a25 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:13:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:03 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:13:03 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:13:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:03 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:13:03 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:13:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-bbbfd14f-7de3-4273-9f9b-0a4946c11a25 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:03 devstack sudo[96452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-bbbfd14f-7de3-4273-9f9b-0a4946c11a25 1073741824 Jul 21 02:13:03 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d5116afd-36e0-4a41-9949-da8346790d46 tempest-AttachVolumeNegativeTest-1066125899 None] Acquiring lock "cinder-5606c8f1-174e-4ba6-a221-3278afd40452-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d5116afd-36e0-4a41-9949-da8346790d46 tempest-AttachVolumeNegativeTest-1066125899 None] Lock "cinder-5606c8f1-174e-4ba6-a221-3278afd40452-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d5116afd-36e0-4a41-9949-da8346790d46 tempest-AttachVolumeNegativeTest-1066125899 None] Acquiring lock "cinder-quobyte-5606c8f1-174e-4ba6-a221-3278afd40452" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d5116afd-36e0-4a41-9949-da8346790d46 tempest-AttachVolumeNegativeTest-1066125899 None] Lock "cinder-quobyte-5606c8f1-174e-4ba6-a221-3278afd40452" acquired by "delete_volume" :: waited 0.017s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:03 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9d62cc-d421-46e5-82ba-9965d4e0a65e]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:13:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d5116afd-36e0-4a41-9949-da8346790d46 tempest-AttachVolumeNegativeTest-1066125899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5606c8f1-174e-4ba6-a221-3278afd40452 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:03 devstack sudo[96454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5606c8f1-174e-4ba6-a221-3278afd40452 Jul 21 02:13:03 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:04 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-bbbfd14f-7de3-4273-9f9b-0a4946c11a25 1073741824" returned: 0 in 0.650s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-bbbfd14f-7de3-4273-9f9b-0a4946c11a25 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:04 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-bbbfd14f-7de3-4273-9f9b-0a4946c11a25 Jul 21 02:13:04 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:04 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d5116afd-36e0-4a41-9949-da8346790d46 tempest-AttachVolumeNegativeTest-1066125899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5606c8f1-174e-4ba6-a221-3278afd40452" returned: 0 in 0.568s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d5116afd-36e0-4a41-9949-da8346790d46 tempest-AttachVolumeNegativeTest-1066125899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5606c8f1-174e-4ba6-a221-3278afd40452 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:04 devstack sudo[96471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5606c8f1-174e-4ba6-a221-3278afd40452 Jul 21 02:13:04 devstack sudo[96471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:04 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-bbbfd14f-7de3-4273-9f9b-0a4946c11a25" returned: 0 in 0.350s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:04 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:13:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d831c44-8ea4-4f76-a991-4e0549de6d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbbfd14f-7de3-4273-9f9b-0a4946c11a25', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cda67f6-d779-445e-aaf7-93fbbe331be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:04 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] Volume volume-bbbfd14f-7de3-4273-9f9b-0a4946c11a25 (bbbfd14f-7de3-4273-9f9b-0a4946c11a25): created successfully Jul 21 02:13:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cda67f6-d779-445e-aaf7-93fbbe331be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] Flow 'volume_create_manager' (e17c79ab-38d8-47a1-a010-90e06c6a1e5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:13:04 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-412ceb79-9448-4bef-bbf3-46faf0514cf1 tempest-AttachVolumeTestJSON-77441230 None] Created volume successfully. Jul 21 02:13:04 devstack sudo[96471]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d5116afd-36e0-4a41-9949-da8346790d46 tempest-AttachVolumeNegativeTest-1066125899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5606c8f1-174e-4ba6-a221-3278afd40452" returned: 0 in 0.394s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:04 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d5116afd-36e0-4a41-9949-da8346790d46 tempest-AttachVolumeNegativeTest-1066125899 None] Lock "cinder-quobyte-5606c8f1-174e-4ba6-a221-3278afd40452" released by "delete_volume" :: held 1.021s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:04 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-d5116afd-36e0-4a41-9949-da8346790d46 tempest-AttachVolumeNegativeTest-1066125899 None] Created reservations ['76d7b153-888f-4dd3-98e4-3d379a565184', 'd222d539-b038-4f78-b8d1-f4f10410bb1d', 'ee68e2dc-f134-4161-997f-fa0306620caa', '51be5f12-c32c-4f38-b468-5265094f7b2a'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:13:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d5116afd-36e0-4a41-9949-da8346790d46 tempest-AttachVolumeNegativeTest-1066125899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d5116afd-36e0-4a41-9949-da8346790d46 tempest-AttachVolumeNegativeTest-1066125899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:04 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d5116afd-36e0-4a41-9949-da8346790d46 tempest-AttachVolumeNegativeTest-1066125899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:13:04 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d5116afd-36e0-4a41-9949-da8346790d46 tempest-AttachVolumeNegativeTest-1066125899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:13:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d5116afd-36e0-4a41-9949-da8346790d46 tempest-AttachVolumeNegativeTest-1066125899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d5116afd-36e0-4a41-9949-da8346790d46 tempest-AttachVolumeNegativeTest-1066125899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:04 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:13:04 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:13:04 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] Flow 'volume_create_manager' (e4b8e20f-00a1-4d06-b37d-1b72261f5f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:13:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b359f73-46c5-49c4-8126-e0164a1d4346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b359f73-46c5-49c4-8126-e0164a1d4346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:13:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1513141154',display_name='tempest-VolumesGetTest-Volume-863117537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b94ee9a-6c70-4841-b746-22c2dfd8c706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59682f03e56f442a95b488e6ada71d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:13:05Z,use_quota=True,user_id='4b359d60f98340a3a412c9a72404c995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (712bebd1-0365-45eb-b6e3-785e739a7827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (712bebd1-0365-45eb-b6e3-785e739a7827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5d62b8c-2408-4373-9a85-d273eebb4a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5d62b8c-2408-4373-9a85-d273eebb4a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b94ee9a-6c70-4841-b746-22c2dfd8c706', 'volume_name': 'volume-5b94ee9a-6c70-4841-b746-22c2dfd8c706', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c3bb54-ce8e-4241-a33f-725e2faf9b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c3bb54-ce8e-4241-a33f-725e2faf9b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b23109f6-d00c-45d7-86ff-e09175004cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:05 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] Volume 5b94ee9a-6c70-4841-b746-22c2dfd8c706: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b94ee9a-6c70-4841-b746-22c2dfd8c706', 'volume_size': 1} Jul 21 02:13:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:13:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1513141154',display_name='tempest-VolumesGetTest-Volume-863117537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b94ee9a-6c70-4841-b746-22c2dfd8c706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59682f03e56f442a95b488e6ada71d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:13:05Z,use_quota=True,user_id='4b359d60f98340a3a412c9a72404c995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:13:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] Creating volume 5b94ee9a-6c70-4841-b746-22c2dfd8c706 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:13:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:13:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:13:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:13:05 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:13:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b94ee9a-6c70-4841-b746-22c2dfd8c706 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:05 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b94ee9a-6c70-4841-b746-22c2dfd8c706 1073741824 Jul 21 02:13:05 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:05 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d5116afd-36e0-4a41-9949-da8346790d46 tempest-AttachVolumeNegativeTest-1066125899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.256s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:05 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-d5116afd-36e0-4a41-9949-da8346790d46 tempest-AttachVolumeNegativeTest-1066125899 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:13:05 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-d5116afd-36e0-4a41-9949-da8346790d46 tempest-AttachVolumeNegativeTest-1066125899 None] Deleted volume successfully. Jul 21 02:13:05 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d5116afd-36e0-4a41-9949-da8346790d46 tempest-AttachVolumeNegativeTest-1066125899 None] Lock "cinder-5606c8f1-174e-4ba6-a221-3278afd40452-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:05 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b94ee9a-6c70-4841-b746-22c2dfd8c706 1073741824" returned: 0 in 0.445s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b94ee9a-6c70-4841-b746-22c2dfd8c706 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:05 devstack sudo[96484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b94ee9a-6c70-4841-b746-22c2dfd8c706 Jul 21 02:13:05 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:05 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b94ee9a-6c70-4841-b746-22c2dfd8c706" returned: 0 in 0.335s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:13:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b23109f6-d00c-45d7-86ff-e09175004cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b94ee9a-6c70-4841-b746-22c2dfd8c706', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ffa2201-020c-4b7b-83ad-46a9b9f1d978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:05 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] Volume volume-5b94ee9a-6c70-4841-b746-22c2dfd8c706 (5b94ee9a-6c70-4841-b746-22c2dfd8c706): created successfully Jul 21 02:13:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ffa2201-020c-4b7b-83ad-46a9b9f1d978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] Flow 'volume_create_manager' (e4b8e20f-00a1-4d06-b37d-1b72261f5f91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:13:05 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-0409448a-baaa-4574-8c04-ab2705e689ca tempest-VolumesGetTest-1773935590 None] Created volume successfully. Jul 21 02:13:06 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-889d362f-0c9d-4cd2-a6cd-5f81ccd79e70 tempest-AttachVolumeNegativeTest-1066125899 None] Acquiring lock "cinder-fdd2dfa4-bf9a-43eb-ae87-e7364115df2f-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:06 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-889d362f-0c9d-4cd2-a6cd-5f81ccd79e70 tempest-AttachVolumeNegativeTest-1066125899 None] Lock "cinder-fdd2dfa4-bf9a-43eb-ae87-e7364115df2f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:06 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-889d362f-0c9d-4cd2-a6cd-5f81ccd79e70 tempest-AttachVolumeNegativeTest-1066125899 None] Acquiring lock "cinder-quobyte-fdd2dfa4-bf9a-43eb-ae87-e7364115df2f" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:06 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-889d362f-0c9d-4cd2-a6cd-5f81ccd79e70 tempest-AttachVolumeNegativeTest-1066125899 None] Lock "cinder-quobyte-fdd2dfa4-bf9a-43eb-ae87-e7364115df2f" acquired by "delete_volume" :: waited 0.022s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:06 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89c0609-1113-493f-9eb6-977a7fff2643]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:13:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-889d362f-0c9d-4cd2-a6cd-5f81ccd79e70 tempest-AttachVolumeNegativeTest-1066125899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fdd2dfa4-bf9a-43eb-ae87-e7364115df2f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:06 devstack sudo[96497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fdd2dfa4-bf9a-43eb-ae87-e7364115df2f Jul 21 02:13:06 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-ddc7dd2e-5a6d-4520-a0e5-447e333109bc req-7b5ff2e2-db08-45e4-8984-fc73dc7c718d tempest-AttachVolumeTestJSON-77441230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-ddc7dd2e-5a6d-4520-a0e5-447e333109bc req-7b5ff2e2-db08-45e4-8984-fc73dc7c718d tempest-AttachVolumeTestJSON-77441230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-ddc7dd2e-5a6d-4520-a0e5-447e333109bc req-7b5ff2e2-db08-45e4-8984-fc73dc7c718d tempest-AttachVolumeTestJSON-77441230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-ddc7dd2e-5a6d-4520-a0e5-447e333109bc req-7b5ff2e2-db08-45e4-8984-fc73dc7c718d tempest-AttachVolumeTestJSON-77441230 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea', 'name': 'volume-bbbfd14f-7de3-4273-9f9b-0a4946c11a25', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe844a57-865f-4992-afa7-4f6f20c0d55e', 'enforce_multipath': True} {{(pid=87566) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 02:13:06 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-ddc7dd2e-5a6d-4520-a0e5-447e333109bc req-7b5ff2e2-db08-45e4-8984-fc73dc7c718d tempest-AttachVolumeTestJSON-77441230 None] attachment_update completed successfully. Jul 21 02:13:06 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-889d362f-0c9d-4cd2-a6cd-5f81ccd79e70 tempest-AttachVolumeNegativeTest-1066125899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fdd2dfa4-bf9a-43eb-ae87-e7364115df2f" returned: 0 in 0.401s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-889d362f-0c9d-4cd2-a6cd-5f81ccd79e70 tempest-AttachVolumeNegativeTest-1066125899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fdd2dfa4-bf9a-43eb-ae87-e7364115df2f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:06 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fdd2dfa4-bf9a-43eb-ae87-e7364115df2f Jul 21 02:13:06 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:07 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-889d362f-0c9d-4cd2-a6cd-5f81ccd79e70 tempest-AttachVolumeNegativeTest-1066125899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fdd2dfa4-bf9a-43eb-ae87-e7364115df2f" returned: 0 in 0.308s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:07 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-889d362f-0c9d-4cd2-a6cd-5f81ccd79e70 tempest-AttachVolumeNegativeTest-1066125899 None] Lock "cinder-quobyte-fdd2dfa4-bf9a-43eb-ae87-e7364115df2f" released by "delete_volume" :: held 0.751s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:07 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-889d362f-0c9d-4cd2-a6cd-5f81ccd79e70 tempest-AttachVolumeNegativeTest-1066125899 None] Created reservations ['2cb14e20-83d6-4e69-81a2-fc0b3266da6c', '4a1b2e9b-2dc0-45b4-bbc6-cbc76a014e2a', '916b6539-a1a3-40d6-ab33-f4c18e2827a0', '9668fd79-3109-4d46-a50d-747ee7c4ad17'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:13:07 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6944cc30-e2d0-49a5-8f8f-26960e56f5ab tempest-VolumesGetTest-1773935590 None] Acquiring lock "cinder-5b94ee9a-6c70-4841-b746-22c2dfd8c706-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:07 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6944cc30-e2d0-49a5-8f8f-26960e56f5ab tempest-VolumesGetTest-1773935590 None] Lock "cinder-5b94ee9a-6c70-4841-b746-22c2dfd8c706-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-889d362f-0c9d-4cd2-a6cd-5f81ccd79e70 tempest-AttachVolumeNegativeTest-1066125899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-889d362f-0c9d-4cd2-a6cd-5f81ccd79e70 tempest-AttachVolumeNegativeTest-1066125899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:07 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-889d362f-0c9d-4cd2-a6cd-5f81ccd79e70 tempest-AttachVolumeNegativeTest-1066125899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:13:07 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-889d362f-0c9d-4cd2-a6cd-5f81ccd79e70 tempest-AttachVolumeNegativeTest-1066125899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:13:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-889d362f-0c9d-4cd2-a6cd-5f81ccd79e70 tempest-AttachVolumeNegativeTest-1066125899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-889d362f-0c9d-4cd2-a6cd-5f81ccd79e70 tempest-AttachVolumeNegativeTest-1066125899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:07 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6944cc30-e2d0-49a5-8f8f-26960e56f5ab tempest-VolumesGetTest-1773935590 None] Acquiring lock "cinder-quobyte-5b94ee9a-6c70-4841-b746-22c2dfd8c706" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:07 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:13:07 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:07 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6944cc30-e2d0-49a5-8f8f-26960e56f5ab tempest-VolumesGetTest-1773935590 None] Lock "cinder-quobyte-5b94ee9a-6c70-4841-b746-22c2dfd8c706" acquired by "delete_volume" :: waited 0.026s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:07 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[6610adcd-ca55-4955-862d-46115c79cfd9]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:13:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6944cc30-e2d0-49a5-8f8f-26960e56f5ab tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b94ee9a-6c70-4841-b746-22c2dfd8c706 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:07 devstack sudo[96890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b94ee9a-6c70-4841-b746-22c2dfd8c706 Jul 21 02:13:07 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:07 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-889d362f-0c9d-4cd2-a6cd-5f81ccd79e70 tempest-AttachVolumeNegativeTest-1066125899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.335s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:07 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-889d362f-0c9d-4cd2-a6cd-5f81ccd79e70 tempest-AttachVolumeNegativeTest-1066125899 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:13:07 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-889d362f-0c9d-4cd2-a6cd-5f81ccd79e70 tempest-AttachVolumeNegativeTest-1066125899 None] Deleted volume successfully. Jul 21 02:13:07 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-889d362f-0c9d-4cd2-a6cd-5f81ccd79e70 tempest-AttachVolumeNegativeTest-1066125899 None] Lock "cinder-fdd2dfa4-bf9a-43eb-ae87-e7364115df2f-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:08 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6944cc30-e2d0-49a5-8f8f-26960e56f5ab tempest-VolumesGetTest-1773935590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b94ee9a-6c70-4841-b746-22c2dfd8c706" returned: 0 in 0.469s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6944cc30-e2d0-49a5-8f8f-26960e56f5ab tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b94ee9a-6c70-4841-b746-22c2dfd8c706 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:08 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b94ee9a-6c70-4841-b746-22c2dfd8c706 Jul 21 02:13:08 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:08 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6944cc30-e2d0-49a5-8f8f-26960e56f5ab tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5b94ee9a-6c70-4841-b746-22c2dfd8c706" returned: 0 in 0.261s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:08 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6944cc30-e2d0-49a5-8f8f-26960e56f5ab tempest-VolumesGetTest-1773935590 None] Lock "cinder-quobyte-5b94ee9a-6c70-4841-b746-22c2dfd8c706" released by "delete_volume" :: held 0.801s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:08 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-6944cc30-e2d0-49a5-8f8f-26960e56f5ab tempest-VolumesGetTest-1773935590 None] Created reservations ['db77c076-7b24-4cf2-8347-f9024327ef17', '775b56af-b16d-4ebf-9083-20b04091ab7a', 'd24407ec-cf0b-4030-8879-796fe8db7b40', 'f35c562d-57f3-4453-bda9-b050cfde25ce'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:13:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6944cc30-e2d0-49a5-8f8f-26960e56f5ab tempest-VolumesGetTest-1773935590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6944cc30-e2d0-49a5-8f8f-26960e56f5ab tempest-VolumesGetTest-1773935590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-6944cc30-e2d0-49a5-8f8f-26960e56f5ab tempest-VolumesGetTest-1773935590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:13:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-6944cc30-e2d0-49a5-8f8f-26960e56f5ab tempest-VolumesGetTest-1773935590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:13:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6944cc30-e2d0-49a5-8f8f-26960e56f5ab tempest-VolumesGetTest-1773935590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6944cc30-e2d0-49a5-8f8f-26960e56f5ab tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:08 devstack sudo[96899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:13:08 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:08 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6944cc30-e2d0-49a5-8f8f-26960e56f5ab tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.411s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:08 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-6944cc30-e2d0-49a5-8f8f-26960e56f5ab tempest-VolumesGetTest-1773935590 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:13:08 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-6944cc30-e2d0-49a5-8f8f-26960e56f5ab tempest-VolumesGetTest-1773935590 None] Deleted volume successfully. Jul 21 02:13:09 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6944cc30-e2d0-49a5-8f8f-26960e56f5ab tempest-VolumesGetTest-1773935590 None] Lock "cinder-5b94ee9a-6c70-4841-b746-22c2dfd8c706-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:09 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:13:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] Flow 'volume_create_manager' (cb94d0d9-1ab8-4b31-b7e1-f8278517354a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:13:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83873650-8d45-4490-9f74-a9c3cf11fa41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83873650-8d45-4490-9f74-a9c3cf11fa41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-911769016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0934880-2d8a-4d93-b42b-3131c9503869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d940d7c2f514f48ae1ed331d1e36db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:13:09Z,use_quota=True,user_id='918e8541ec7742d2b22e778a1643bed9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efe9e84b-43b9-455f-aee8-cdb4b1d03b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efe9e84b-43b9-455f-aee8-cdb4b1d03b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f063072-a453-47c0-8a90-42f3ba7590ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f063072-a453-47c0-8a90-42f3ba7590ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0934880-2d8a-4d93-b42b-3131c9503869', 'volume_name': 'volume-a0934880-2d8a-4d93-b42b-3131c9503869', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f836aa-7d45-4b8f-9916-f90637f037aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f836aa-7d45-4b8f-9916-f90637f037aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (616bb73f-2b84-49bc-bafd-21d070424b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:09 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] Volume a0934880-2d8a-4d93-b42b-3131c9503869: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0934880-2d8a-4d93-b42b-3131c9503869', 'volume_size': 1} Jul 21 02:13:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:09 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-911769016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0934880-2d8a-4d93-b42b-3131c9503869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d940d7c2f514f48ae1ed331d1e36db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:13:09Z,use_quota=True,user_id='918e8541ec7742d2b22e778a1643bed9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:13:09 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] Creating volume a0934880-2d8a-4d93-b42b-3131c9503869 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:13:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:09 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:13:09 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:13:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:09 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:13:09 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:13:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a0934880-2d8a-4d93-b42b-3131c9503869 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:09 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-bc658c23-141e-4adf-87f5-6110f0e3a364 tempest-VolumesGetTest-1773935590 None] Acquiring lock "cinder-9feecfbe-13da-4d19-b2e8-351d5d728176-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:09 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-bc658c23-141e-4adf-87f5-6110f0e3a364 tempest-VolumesGetTest-1773935590 None] Lock "cinder-9feecfbe-13da-4d19-b2e8-351d5d728176-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:09 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a0934880-2d8a-4d93-b42b-3131c9503869 1073741824 Jul 21 02:13:09 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:09 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-bc658c23-141e-4adf-87f5-6110f0e3a364 tempest-VolumesGetTest-1773935590 None] Acquiring lock "cinder-quobyte-9feecfbe-13da-4d19-b2e8-351d5d728176" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:09 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-bc658c23-141e-4adf-87f5-6110f0e3a364 tempest-VolumesGetTest-1773935590 None] Lock "cinder-quobyte-9feecfbe-13da-4d19-b2e8-351d5d728176" acquired by "delete_volume" :: waited 0.018s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:09 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[9584882b-5c71-4351-be85-8318de30c80f]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:13:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-bc658c23-141e-4adf-87f5-6110f0e3a364 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9feecfbe-13da-4d19-b2e8-351d5d728176 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:09 devstack sudo[96905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9feecfbe-13da-4d19-b2e8-351d5d728176 Jul 21 02:13:09 devstack sudo[96905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:10 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a0934880-2d8a-4d93-b42b-3131c9503869 1073741824" returned: 0 in 0.602s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:10 devstack sudo[96905]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-bc658c23-141e-4adf-87f5-6110f0e3a364 tempest-VolumesGetTest-1773935590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9feecfbe-13da-4d19-b2e8-351d5d728176" returned: 0 in 0.473s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-bc658c23-141e-4adf-87f5-6110f0e3a364 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9feecfbe-13da-4d19-b2e8-351d5d728176 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a0934880-2d8a-4d93-b42b-3131c9503869 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:10 devstack sudo[96914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9feecfbe-13da-4d19-b2e8-351d5d728176 Jul 21 02:13:10 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:10 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a0934880-2d8a-4d93-b42b-3131c9503869 Jul 21 02:13:10 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:10 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-bc658c23-141e-4adf-87f5-6110f0e3a364 tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9feecfbe-13da-4d19-b2e8-351d5d728176" returned: 0 in 0.332s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:10 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-bc658c23-141e-4adf-87f5-6110f0e3a364 tempest-VolumesGetTest-1773935590 None] Lock "cinder-quobyte-9feecfbe-13da-4d19-b2e8-351d5d728176" released by "delete_volume" :: held 0.869s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:10 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a0934880-2d8a-4d93-b42b-3131c9503869" returned: 0 in 0.366s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:10 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:13:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (616bb73f-2b84-49bc-bafd-21d070424b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0934880-2d8a-4d93-b42b-3131c9503869', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (479ce463-1963-4cc5-a93f-f445d27d0e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:10 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] Volume volume-a0934880-2d8a-4d93-b42b-3131c9503869 (a0934880-2d8a-4d93-b42b-3131c9503869): created successfully Jul 21 02:13:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (479ce463-1963-4cc5-a93f-f445d27d0e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] Flow 'volume_create_manager' (cb94d0d9-1ab8-4b31-b7e1-f8278517354a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:13:10 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-71a310a4-608d-423f-8d03-061fab7d74cd tempest-AttachVolumeTestJSON-77441230 None] Created volume successfully. Jul 21 02:13:10 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-bc658c23-141e-4adf-87f5-6110f0e3a364 tempest-VolumesGetTest-1773935590 None] Created reservations ['0b2633e9-5fff-4bda-b105-4c9099d7d614', 'ac8b25ca-e3ae-4d8d-bbf2-c9acb85ef063', '21c39507-4088-4d0e-be2f-1eba8e71a7f3', 'c5c253d7-8ec8-41be-9a37-ab88b75955b3'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:13:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-bc658c23-141e-4adf-87f5-6110f0e3a364 tempest-VolumesGetTest-1773935590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-bc658c23-141e-4adf-87f5-6110f0e3a364 tempest-VolumesGetTest-1773935590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:10 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-bc658c23-141e-4adf-87f5-6110f0e3a364 tempest-VolumesGetTest-1773935590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:13:10 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-bc658c23-141e-4adf-87f5-6110f0e3a364 tempest-VolumesGetTest-1773935590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:13:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-bc658c23-141e-4adf-87f5-6110f0e3a364 tempest-VolumesGetTest-1773935590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-bc658c23-141e-4adf-87f5-6110f0e3a364 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:10 devstack sudo[96920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:13:10 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:11 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-bc658c23-141e-4adf-87f5-6110f0e3a364 tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.347s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:11 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-bc658c23-141e-4adf-87f5-6110f0e3a364 tempest-VolumesGetTest-1773935590 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:13:11 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-bc658c23-141e-4adf-87f5-6110f0e3a364 tempest-VolumesGetTest-1773935590 None] Deleted volume successfully. Jul 21 02:13:11 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-bc658c23-141e-4adf-87f5-6110f0e3a364 tempest-VolumesGetTest-1773935590 None] Lock "cinder-9feecfbe-13da-4d19-b2e8-351d5d728176-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:12 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:13:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] Flow 'volume_create_manager' (602230fb-602c-4f2a-a89e-ebc448f4239d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:13:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7962fd33-9fb3-4a4f-a0c3-9281c2c38d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7962fd33-9fb3-4a4f-a0c3-9281c2c38d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1480993854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=801e744c-df66-47c7-9b97-8771602d208a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59682f03e56f442a95b488e6ada71d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:13:13Z,use_quota=True,user_id='4b359d60f98340a3a412c9a72404c995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71f471a-92f3-405a-b019-a1fab5bd3a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71f471a-92f3-405a-b019-a1fab5bd3a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c320640-bf53-4011-974b-a61299ef0ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c320640-bf53-4011-974b-a61299ef0ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '801e744c-df66-47c7-9b97-8771602d208a', 'volume_name': 'volume-801e744c-df66-47c7-9b97-8771602d208a', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08e3fad0-2533-4a13-ab3c-29ba3bb2abfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08e3fad0-2533-4a13-ab3c-29ba3bb2abfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537c9cc8-01fc-44d7-9bc4-7f5aee5396a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:12 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] Volume 801e744c-df66-47c7-9b97-8771602d208a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-801e744c-df66-47c7-9b97-8771602d208a', 'volume_size': 1} Jul 21 02:13:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1480993854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=801e744c-df66-47c7-9b97-8771602d208a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59682f03e56f442a95b488e6ada71d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:13:13Z,use_quota=True,user_id='4b359d60f98340a3a412c9a72404c995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:13:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] Creating volume 801e744c-df66-47c7-9b97-8771602d208a {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:13:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:13:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:13:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:13:12 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:13:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-a7ff004b-c4ae-4568-a0cf-9c92540e8c2a req-8d3aeb0a-2a2f-4252-bcba-1bd391abb257 tempest-AttachVolumeTestJSON-77441230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:12 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a 1073741824 Jul 21 02:13:12 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:13 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a 1073741824" returned: 0 in 0.581s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:13 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a Jul 21 02:13:13 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:13 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a" returned: 0 in 0.314s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:13:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-a7ff004b-c4ae-4568-a0cf-9c92540e8c2a req-8d3aeb0a-2a2f-4252-bcba-1bd391abb257 tempest-AttachVolumeTestJSON-77441230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.918s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-a7ff004b-c4ae-4568-a0cf-9c92540e8c2a req-8d3aeb0a-2a2f-4252-bcba-1bd391abb257 tempest-AttachVolumeTestJSON-77441230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537c9cc8-01fc-44d7-9bc4-7f5aee5396a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-801e744c-df66-47c7-9b97-8771602d208a', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e73a2b9-b61e-48c3-9532-7334ba8d2227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:13 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] Volume volume-801e744c-df66-47c7-9b97-8771602d208a (801e744c-df66-47c7-9b97-8771602d208a): created successfully Jul 21 02:13:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e73a2b9-b61e-48c3-9532-7334ba8d2227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] Flow 'volume_create_manager' (602230fb-602c-4f2a-a89e-ebc448f4239d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:13:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-a7ff004b-c4ae-4568-a0cf-9c92540e8c2a req-8d3aeb0a-2a2f-4252-bcba-1bd391abb257 tempest-AttachVolumeTestJSON-77441230 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea', 'name': 'volume-a0934880-2d8a-4d93-b42b-3131c9503869', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c56302ba-f38d-40d6-bb76-3b135c44bdf0', 'enforce_multipath': True} {{(pid=87566) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 02:13:13 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-dfc7e24c-e14c-445e-bd83-905557e18186 tempest-VolumesGetTest-1773935590 None] Created volume successfully. Jul 21 02:13:14 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-a7ff004b-c4ae-4568-a0cf-9c92540e8c2a req-8d3aeb0a-2a2f-4252-bcba-1bd391abb257 tempest-AttachVolumeTestJSON-77441230 None] attachment_update completed successfully. Jul 21 02:13:14 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:13:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] Flow 'volume_create_manager' (ee614253-a441-4f09-8db0-d1a096c8828b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:13:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42ca761-e42d-4315-ba15-795b9c07ab78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42ca761-e42d-4315-ba15-795b9c07ab78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-434325063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=683285b7-a02c-4fcd-bc2c-abbfcb02905f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d3c4a7114f483d965a4e1521e0841c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:13:15Z,use_quota=True,user_id='09098e2e11134102ae063cc53690258c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c03a5f-3690-4483-953d-2c8a6caad6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c03a5f-3690-4483-953d-2c8a6caad6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a726e4f1-72bc-42de-8f4a-79302d2559ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a726e4f1-72bc-42de-8f4a-79302d2559ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '683285b7-a02c-4fcd-bc2c-abbfcb02905f', 'volume_name': 'volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9243fe21-4a77-4847-a4af-721bedb80331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9243fe21-4a77-4847-a4af-721bedb80331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3835636a-4add-4774-b789-280a447a79f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:14 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] Volume 683285b7-a02c-4fcd-bc2c-abbfcb02905f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f', 'volume_size': 1} Jul 21 02:13:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-434325063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=683285b7-a02c-4fcd-bc2c-abbfcb02905f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d3c4a7114f483d965a4e1521e0841c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:13:15Z,use_quota=True,user_id='09098e2e11134102ae063cc53690258c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:13:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] Creating volume 683285b7-a02c-4fcd-bc2c-abbfcb02905f {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:13:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:13:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:13:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:13:14 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:13:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:14 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f 1073741824 Jul 21 02:13:14 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:15 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:13:15 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f 1073741824" returned: 0 in 0.493s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Flow 'volume_create_manager' (f1a95c0a-0ad9-4ccf-9d2a-48d95750602d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:13:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (248d65ae-ad4e-4a87-b185-de52af4fa6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (248d65ae-ad4e-4a87-b185-de52af4fa6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1985319070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01785306-ecdf-413d-ba11-33ddeac4d025,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='59682f03e56f442a95b488e6ada71d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=801e744c-df66-47c7-9b97-8771602d208a,status='creating',terminated_at=None,updated_at=2026-07-21T00:13:15Z,use_quota=True,user_id='4b359d60f98340a3a412c9a72404c995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe84978f-422c-4f54-a1ba-302771c26bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe84978f-422c-4f54-a1ba-302771c26bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f94107-e22a-4228-b863-8d1d350888b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f94107-e22a-4228-b863-8d1d350888b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '01785306-ecdf-413d-ba11-33ddeac4d025', 'volume_name': 'volume-01785306-ecdf-413d-ba11-33ddeac4d025', 'volume_size': 1, 'source_volid': '801e744c-df66-47c7-9b97-8771602d208a', 'source_volstatus': 'available'}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab5d2e4-6f4b-4e1d-aeed-5762da0286a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab5d2e4-6f4b-4e1d-aeed-5762da0286a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0dc783f-a59b-4fe0-b877-76661e90733f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:15 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Volume 01785306-ecdf-413d-ba11-33ddeac4d025: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-01785306-ecdf-413d-ba11-33ddeac4d025', 'volume_size': 1, 'source_volid': '801e744c-df66-47c7-9b97-8771602d208a', 'source_volstatus': 'available'} Jul 21 02:13:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:15 devstack sudo[96961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f Jul 21 02:13:15 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:15 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f" returned: 0 in 0.293s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:13:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.274s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:15 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Cloning volume 801e744c-df66-47c7-9b97-8771602d208a to volume 01785306-ecdf-413d-ba11-33ddeac4d025 Jul 21 02:13:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3835636a-4add-4774-b789-280a447a79f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (219ad73e-9655-4cd8-8f46-29a5e6aa1f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:15 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] Volume volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f (683285b7-a02c-4fcd-bc2c-abbfcb02905f): created successfully Jul 21 02:13:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (219ad73e-9655-4cd8-8f46-29a5e6aa1f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] Flow 'volume_create_manager' (ee614253-a441-4f09-8db0-d1a096c8828b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:13:15 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-f0176ad9-0da6-4bd7-927a-4d495e38fe6f tempest-VolumesActionsTest-1474695972 None] Created volume successfully. Jul 21 02:13:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Creating offline snapshot 9899ee89-82a3-4435-a352-bb766ee275ee of volume 801e744c-df66-47c7-9b97-8771602d208a {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:13:15 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[a126a0a4-bd76-4458-af8c-7c7b7172876d]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:13:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:16 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a Jul 21 02:13:16 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:16 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a" returned: 0 in 0.488s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a.9899ee89-82a3-4435-a352-bb766ee275ee 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:16 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a.9899ee89-82a3-4435-a352-bb766ee275ee 1G Jul 21 02:13:16 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:16 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-0bcd6411-f503-42db-868a-080bab3a018d req-d97ddd1d-3bb5-4fc5-b815-54a2ce03d7b0 tempest-AttachVolumeTestJSON-77441230 None] Terminate volume connection completed successfully. Jul 21 02:13:16 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-0bcd6411-f503-42db-868a-080bab3a018d req-d97ddd1d-3bb5-4fc5-b815-54a2ce03d7b0 tempest-AttachVolumeTestJSON-77441230 None] Deleting attachment fe844a57-865f-4992-afa7-4f6f20c0d55e. {{(pid=87566) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 02:13:16 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a.9899ee89-82a3-4435-a352-bb766ee275ee 1G" returned: 0 in 0.504s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-801e744c-df66-47c7-9b97-8771602d208a -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a.9899ee89-82a3-4435-a352-bb766ee275ee {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:17 devstack sudo[96979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-801e744c-df66-47c7-9b97-8771602d208a -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a.9899ee89-82a3-4435-a352-bb766ee275ee Jul 21 02:13:17 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:17 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-801e744c-df66-47c7-9b97-8771602d208a -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a.9899ee89-82a3-4435-a352-bb766ee275ee" returned: 0 in 0.345s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:17 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a.9899ee89-82a3-4435-a352-bb766ee275ee is being set with open permissions: ugo+rw Jul 21 02:13:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a.9899ee89-82a3-4435-a352-bb766ee275ee {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:17 devstack sudo[96984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a.9899ee89-82a3-4435-a352-bb766ee275ee Jul 21 02:13:17 devstack sudo[96984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:17 devstack sudo[96984]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a.9899ee89-82a3-4435-a352-bb766ee275ee" returned: 0 in 0.322s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:17 devstack sudo[96987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a.info Jul 21 02:13:17 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:18 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a.info" returned: 0 in 0.398s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:18 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a.info is being set with open permissions: ugo+rw Jul 21 02:13:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:18 devstack sudo[96993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a.info Jul 21 02:13:18 devstack sudo[96993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:18 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-4a896519-0882-4220-bb53-11a793572a4b req-bc47a629-d514-4b93-bd77-130124d9feea tempest-AttachVolumeTestJSON-77441230 None] Terminate volume connection completed successfully. Jul 21 02:13:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-4a896519-0882-4220-bb53-11a793572a4b req-bc47a629-d514-4b93-bd77-130124d9feea tempest-AttachVolumeTestJSON-77441230 None] Deleting attachment c56302ba-f38d-40d6-bb76-3b135c44bdf0. {{(pid=87566) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 02:13:18 devstack sudo[96993]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a.info" returned: 0 in 0.356s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Acquiring lock "cinder-quobyte-01785306-ecdf-413d-ba11-33ddeac4d025" by "_copy_volume_from_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Lock "cinder-quobyte-01785306-ecdf-413d-ba11-33ddeac4d025" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] snapshot: 9899ee89-82a3-4435-a352-bb766ee275ee, volume: 01785306-ecdf-413d-ba11-33ddeac4d025, {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 02:13:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:13:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:13:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:18 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eba2595-6d49-4087-8217-70e818062ba6]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:13:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a.9899ee89-82a3-4435-a352-bb766ee275ee {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:18 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a.9899ee89-82a3-4435-a352-bb766ee275ee Jul 21 02:13:18 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:18 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a.9899ee89-82a3-4435-a352-bb766ee275ee" returned: 0 in 0.452s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-801e744c-df66-47c7-9b97-8771602d208a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:13:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 02:13:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Creating direct copy from snapshot {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 02:13:18 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52e6df8-fafa-463a-90a4-3fcde0bd701f]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:13:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:19 devstack sudo[97028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a Jul 21 02:13:19 devstack sudo[97028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:19 devstack sudo[97028]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a" returned: 0 in 0.495s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:19 devstack cinder-volume[87566]: DEBUG cinder.utils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Path /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-01785306-ecdf-413d-ba11-33ddeac4d025 not found in is_blk_device check {{(pid=87566) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 02:13:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-01785306-ecdf-413d-ba11-33ddeac4d025 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:19 devstack sudo[97033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-01785306-ecdf-413d-ba11-33ddeac4d025 Jul 21 02:13:19 devstack sudo[97033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-01785306-ecdf-413d-ba11-33ddeac4d025" returned: 0 in 7.238s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:26 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24db2ac-3697-4939-ad40-446636e62633]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:13:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:26 devstack sudo[97121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a Jul 21 02:13:26 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:27 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=92,cinder:INSERT=30,cinder:UPDATE=100,cinder:DELETE=5 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:13:27 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a" returned: 0 in 0.976s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:27 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Image conversion details: src /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a, size 1024.00 MB, duration 7.24 sec, destination /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-01785306-ecdf-413d-ba11-33ddeac4d025 {{(pid=87566) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 02:13:27 devstack cinder-volume[87566]: INFO cinder.image.image_utils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Converted 1024.00 MB image at 141.46 MB/s Jul 21 02:13:27 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-01785306-ecdf-413d-ba11-33ddeac4d025 is being set with open permissions: ugo+rw Jul 21 02:13:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-01785306-ecdf-413d-ba11-33ddeac4d025 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:27 devstack sudo[97157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-01785306-ecdf-413d-ba11-33ddeac4d025 Jul 21 02:13:27 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:28 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-01785306-ecdf-413d-ba11-33ddeac4d025" returned: 0 in 0.366s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:28 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Lock "cinder-quobyte-01785306-ecdf-413d-ba11-33ddeac4d025" released by "_copy_volume_from_snapshot" :: held 9.671s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:28 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Acquiring lock "cinder-quobyte-9899ee89-82a3-4435-a352-bb766ee275ee" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:28 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Lock "cinder-quobyte-9899ee89-82a3-4435-a352-bb766ee275ee" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:28 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Deleting offline snapshot 9899ee89-82a3-4435-a352-bb766ee275ee of volume 801e744c-df66-47c7-9b97-8771602d208a {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:13:28 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] snapshot_file for this snap is: volume-801e744c-df66-47c7-9b97-8771602d208a.9899ee89-82a3-4435-a352-bb766ee275ee {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:13:28 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d556c7-c261-44de-aa18-ef4d1e9dc271]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:13:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a.9899ee89-82a3-4435-a352-bb766ee275ee {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:28 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:UPDATE=105,cinder:SELECT=91,cinder:INSERT=17,cinder:DELETE=12 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:13:28 devstack sudo[97166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a.9899ee89-82a3-4435-a352-bb766ee275ee Jul 21 02:13:28 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:28 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a.9899ee89-82a3-4435-a352-bb766ee275ee" returned: 0 in 0.737s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:29 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-801e744c-df66-47c7-9b97-8771602d208a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:13:29 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[270df93c-6b16-46ba-ba6b-d291c274c6c0]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:13:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:29 devstack sudo[97172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a Jul 21 02:13:29 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:29 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1bbb2ba0-ab64-44c4-9f8b-53a5a9b4304c tempest-AttachVolumeTestJSON-77441230 None] Acquiring lock "cinder-a0934880-2d8a-4d93-b42b-3131c9503869-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:29 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-61db3e67-05a4-446c-bf56-0ab162c48b4f tempest-VolumesActionsTest-1474695972 None] Acquiring lock "cinder-683285b7-a02c-4fcd-bc2c-abbfcb02905f" by "attach_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:29 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1bbb2ba0-ab64-44c4-9f8b-53a5a9b4304c tempest-AttachVolumeTestJSON-77441230 None] Lock "cinder-a0934880-2d8a-4d93-b42b-3131c9503869-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:29 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-61db3e67-05a4-446c-bf56-0ab162c48b4f tempest-VolumesActionsTest-1474695972 None] Lock "cinder-683285b7-a02c-4fcd-bc2c-abbfcb02905f" acquired by "attach_volume" :: waited 0.051s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:29 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1bbb2ba0-ab64-44c4-9f8b-53a5a9b4304c tempest-AttachVolumeTestJSON-77441230 None] Acquiring lock "cinder-quobyte-a0934880-2d8a-4d93-b42b-3131c9503869" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:29 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1bbb2ba0-ab64-44c4-9f8b-53a5a9b4304c tempest-AttachVolumeTestJSON-77441230 None] Lock "cinder-quobyte-a0934880-2d8a-4d93-b42b-3131c9503869" acquired by "delete_volume" :: waited 0.027s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:29 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-61db3e67-05a4-446c-bf56-0ab162c48b4f tempest-VolumesActionsTest-1474695972 None] Attaching volume 683285b7-a02c-4fcd-bc2c-abbfcb02905f to instance 39f08c54-139d-4004-90ad-8c9af6889b41 at mountpoint /dev/vdb on host None. Jul 21 02:13:29 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[d311b0b6-b5a0-4491-ad17-d9b3254ddd13]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:13:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1bbb2ba0-ab64-44c4-9f8b-53a5a9b4304c tempest-AttachVolumeTestJSON-77441230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a0934880-2d8a-4d93-b42b-3131c9503869 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:29 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-61db3e67-05a4-446c-bf56-0ab162c48b4f tempest-VolumesActionsTest-1474695972 None] Attach volume completed successfully. Jul 21 02:13:29 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-61db3e67-05a4-446c-bf56-0ab162c48b4f tempest-VolumesActionsTest-1474695972 None] Lock "cinder-683285b7-a02c-4fcd-bc2c-abbfcb02905f" released by "attach_volume" :: held 0.230s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:29 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a" returned: 0 in 0.683s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a.9899ee89-82a3-4435-a352-bb766ee275ee {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:29 devstack sudo[97179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a.9899ee89-82a3-4435-a352-bb766ee275ee Jul 21 02:13:29 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:29 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a0934880-2d8a-4d93-b42b-3131c9503869 Jul 21 02:13:29 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:29 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-88c5afae-9bf2-4cf7-89a6-f70add6f7577 tempest-VolumesActionsTest-1474695972 None] Acquiring lock "cinder-683285b7-a02c-4fcd-bc2c-abbfcb02905f-detach_volume" by "detach_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-88c5afae-9bf2-4cf7-89a6-f70add6f7577 tempest-VolumesActionsTest-1474695972 None] Lock "cinder-683285b7-a02c-4fcd-bc2c-abbfcb02905f-detach_volume" acquired by "detach_volume" :: waited 0.044s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:30 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-88c5afae-9bf2-4cf7-89a6-f70add6f7577 tempest-VolumesActionsTest-1474695972 None] Detaching volume 683285b7-a02c-4fcd-bc2c-abbfcb02905f from instance 39f08c54-139d-4004-90ad-8c9af6889b41. Jul 21 02:13:30 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-88c5afae-9bf2-4cf7-89a6-f70add6f7577 tempest-VolumesActionsTest-1474695972 None] Detach volume completed successfully. Jul 21 02:13:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-88c5afae-9bf2-4cf7-89a6-f70add6f7577 tempest-VolumesActionsTest-1474695972 None] Lock "cinder-683285b7-a02c-4fcd-bc2c-abbfcb02905f-detach_volume" released by "detach_volume" :: held 0.152s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:30 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1bbb2ba0-ab64-44c4-9f8b-53a5a9b4304c tempest-AttachVolumeTestJSON-77441230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a0934880-2d8a-4d93-b42b-3131c9503869" returned: 0 in 0.666s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1bbb2ba0-ab64-44c4-9f8b-53a5a9b4304c tempest-AttachVolumeTestJSON-77441230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a0934880-2d8a-4d93-b42b-3131c9503869 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:30 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a.9899ee89-82a3-4435-a352-bb766ee275ee" returned: 0 in 0.618s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a.9899ee89-82a3-4435-a352-bb766ee275ee {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:30 devstack sudo[97189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a0934880-2d8a-4d93-b42b-3131c9503869 Jul 21 02:13:30 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:30 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a.9899ee89-82a3-4435-a352-bb766ee275ee Jul 21 02:13:30 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:30 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a.9899ee89-82a3-4435-a352-bb766ee275ee" returned: 0 in 0.415s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Lock "cinder-quobyte-9899ee89-82a3-4435-a352-bb766ee275ee" released by "_delete_snapshot" :: held 2.630s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:30 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1bbb2ba0-ab64-44c4-9f8b-53a5a9b4304c tempest-AttachVolumeTestJSON-77441230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a0934880-2d8a-4d93-b42b-3131c9503869" returned: 0 in 0.532s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1bbb2ba0-ab64-44c4-9f8b-53a5a9b4304c tempest-AttachVolumeTestJSON-77441230 None] Lock "cinder-quobyte-a0934880-2d8a-4d93-b42b-3131c9503869" released by "delete_volume" :: held 1.268s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.072s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0dc783f-a59b-4fe0-b877-76661e90733f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01785306-ecdf-413d-ba11-33ddeac4d025', 'volume_size': 1, 'source_volid': '801e744c-df66-47c7-9b97-8771602d208a', 'source_volstatus': 'available'}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62558048-381c-4d38-a04a-66cd86c7a088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:30 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Volume volume-01785306-ecdf-413d-ba11-33ddeac4d025 (01785306-ecdf-413d-ba11-33ddeac4d025): created successfully Jul 21 02:13:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62558048-381c-4d38-a04a-66cd86c7a088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Flow 'volume_create_manager' (f1a95c0a-0ad9-4ccf-9d2a-48d95750602d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:13:31 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-1bbb2ba0-ab64-44c4-9f8b-53a5a9b4304c tempest-AttachVolumeTestJSON-77441230 None] Created reservations ['e45b7789-5547-4568-b2fe-5bae2b5df255', '3db4b8c0-c3b8-4d63-8fcd-68fde67ba55c', 'b580b78e-e70b-4182-a654-99a1aa1ba726', 'c2938eff-f98e-45df-8a96-a341ae7b40cd'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:13:31 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-2624158b-b471-4d11-91f8-72ecce0d1de4 tempest-VolumesGetTest-1773935590 None] Created volume successfully. Jul 21 02:13:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-1bbb2ba0-ab64-44c4-9f8b-53a5a9b4304c tempest-AttachVolumeTestJSON-77441230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-1bbb2ba0-ab64-44c4-9f8b-53a5a9b4304c tempest-AttachVolumeTestJSON-77441230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:31 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-1bbb2ba0-ab64-44c4-9f8b-53a5a9b4304c tempest-AttachVolumeTestJSON-77441230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:13:31 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-1bbb2ba0-ab64-44c4-9f8b-53a5a9b4304c tempest-AttachVolumeTestJSON-77441230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:13:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-1bbb2ba0-ab64-44c4-9f8b-53a5a9b4304c tempest-AttachVolumeTestJSON-77441230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1bbb2ba0-ab64-44c4-9f8b-53a5a9b4304c tempest-AttachVolumeTestJSON-77441230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:31 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:13:31 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:31 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1bbb2ba0-ab64-44c4-9f8b-53a5a9b4304c tempest-AttachVolumeTestJSON-77441230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.480s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:31 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-1bbb2ba0-ab64-44c4-9f8b-53a5a9b4304c tempest-AttachVolumeTestJSON-77441230 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:13:31 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-1bbb2ba0-ab64-44c4-9f8b-53a5a9b4304c tempest-AttachVolumeTestJSON-77441230 None] Deleted volume successfully. Jul 21 02:13:31 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1bbb2ba0-ab64-44c4-9f8b-53a5a9b4304c tempest-AttachVolumeTestJSON-77441230 None] Lock "cinder-a0934880-2d8a-4d93-b42b-3131c9503869-delete_volume" released by "delete_volume" :: held 2.224s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:31 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f78bea2e-113b-4b8a-ae96-4068404eb4c6 tempest-AttachVolumeTestJSON-77441230 None] Acquiring lock "cinder-bbbfd14f-7de3-4273-9f9b-0a4946c11a25-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:31 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f78bea2e-113b-4b8a-ae96-4068404eb4c6 tempest-AttachVolumeTestJSON-77441230 None] Lock "cinder-bbbfd14f-7de3-4273-9f9b-0a4946c11a25-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:31 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f78bea2e-113b-4b8a-ae96-4068404eb4c6 tempest-AttachVolumeTestJSON-77441230 None] Acquiring lock "cinder-quobyte-bbbfd14f-7de3-4273-9f9b-0a4946c11a25" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:31 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f78bea2e-113b-4b8a-ae96-4068404eb4c6 tempest-AttachVolumeTestJSON-77441230 None] Lock "cinder-quobyte-bbbfd14f-7de3-4273-9f9b-0a4946c11a25" acquired by "delete_volume" :: waited 0.032s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:32 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4252ed-7ef7-413e-9924-e0fa3bd026a2]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:13:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f78bea2e-113b-4b8a-ae96-4068404eb4c6 tempest-AttachVolumeTestJSON-77441230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-bbbfd14f-7de3-4273-9f9b-0a4946c11a25 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:32 devstack sudo[97220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-bbbfd14f-7de3-4273-9f9b-0a4946c11a25 Jul 21 02:13:32 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:32 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:13:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] Flow 'volume_create_manager' (e7a79b1e-58d9-42b9-91fe-2fc5e3e5094b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:13:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31648bd6-29ce-4c7e-acf2-5151b544c33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31648bd6-29ce-4c7e-acf2-5151b544c33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:13:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1428560202',display_name='tempest-VolumesGetTest-Volume-1242541466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a72238d-a18f-4441-9841-b0064600e7e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59682f03e56f442a95b488e6ada71d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:13:32Z,use_quota=True,user_id='4b359d60f98340a3a412c9a72404c995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aff02d8-c50b-4dc2-bad1-261f74f30b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aff02d8-c50b-4dc2-bad1-261f74f30b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:32 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a83be148-b6d6-44bd-a530-6084c5ccb7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a83be148-b6d6-44bd-a530-6084c5ccb7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a72238d-a18f-4441-9841-b0064600e7e8', 'volume_name': 'volume-3a72238d-a18f-4441-9841-b0064600e7e8', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a49bcc1e-9ee7-4a97-a1f2-9f06f77d7ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a49bcc1e-9ee7-4a97-a1f2-9f06f77d7ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21052ea-c35e-42b9-924f-df31927d71d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:32 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] Volume 3a72238d-a18f-4441-9841-b0064600e7e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a72238d-a18f-4441-9841-b0064600e7e8', 'volume_size': 1} Jul 21 02:13:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:32 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:13:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1428560202',display_name='tempest-VolumesGetTest-Volume-1242541466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a72238d-a18f-4441-9841-b0064600e7e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59682f03e56f442a95b488e6ada71d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:13:32Z,use_quota=True,user_id='4b359d60f98340a3a412c9a72404c995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:13:32 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] Creating volume 3a72238d-a18f-4441-9841-b0064600e7e8 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:13:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:32 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:13:32 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:13:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:32 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:13:32 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:13:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a72238d-a18f-4441-9841-b0064600e7e8 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f78bea2e-113b-4b8a-ae96-4068404eb4c6 tempest-AttachVolumeTestJSON-77441230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-bbbfd14f-7de3-4273-9f9b-0a4946c11a25" returned: 0 in 0.554s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f78bea2e-113b-4b8a-ae96-4068404eb4c6 tempest-AttachVolumeTestJSON-77441230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-bbbfd14f-7de3-4273-9f9b-0a4946c11a25 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:32 devstack sudo[97228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a72238d-a18f-4441-9841-b0064600e7e8 1073741824 Jul 21 02:13:32 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:32 devstack sudo[97229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-bbbfd14f-7de3-4273-9f9b-0a4946c11a25 Jul 21 02:13:32 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:32 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f78bea2e-113b-4b8a-ae96-4068404eb4c6 tempest-AttachVolumeTestJSON-77441230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-bbbfd14f-7de3-4273-9f9b-0a4946c11a25" returned: 0 in 0.325s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:32 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f78bea2e-113b-4b8a-ae96-4068404eb4c6 tempest-AttachVolumeTestJSON-77441230 None] Lock "cinder-quobyte-bbbfd14f-7de3-4273-9f9b-0a4946c11a25" released by "delete_volume" :: held 0.942s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:33 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-f78bea2e-113b-4b8a-ae96-4068404eb4c6 tempest-AttachVolumeTestJSON-77441230 None] Created reservations ['28ad710e-51ba-44e2-910b-b6d576feed34', 'b57df4d9-4977-4ad9-946f-b304a65743d5', '928eadf2-67e3-461e-82ba-2781b434cb8a', 'b2e7b9a6-41e5-4fa8-9dc1-35e8f4df287f'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:13:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f78bea2e-113b-4b8a-ae96-4068404eb4c6 tempest-AttachVolumeTestJSON-77441230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f78bea2e-113b-4b8a-ae96-4068404eb4c6 tempest-AttachVolumeTestJSON-77441230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:33 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f78bea2e-113b-4b8a-ae96-4068404eb4c6 tempest-AttachVolumeTestJSON-77441230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:13:33 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f78bea2e-113b-4b8a-ae96-4068404eb4c6 tempest-AttachVolumeTestJSON-77441230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:13:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f78bea2e-113b-4b8a-ae96-4068404eb4c6 tempest-AttachVolumeTestJSON-77441230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f78bea2e-113b-4b8a-ae96-4068404eb4c6 tempest-AttachVolumeTestJSON-77441230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:33 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:13:33 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:33 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a72238d-a18f-4441-9841-b0064600e7e8 1073741824" returned: 0 in 0.595s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a72238d-a18f-4441-9841-b0064600e7e8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:33 devstack sudo[97239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a72238d-a18f-4441-9841-b0064600e7e8 Jul 21 02:13:33 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:33 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f78bea2e-113b-4b8a-ae96-4068404eb4c6 tempest-AttachVolumeTestJSON-77441230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.296s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:33 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-f78bea2e-113b-4b8a-ae96-4068404eb4c6 tempest-AttachVolumeTestJSON-77441230 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:13:33 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-f78bea2e-113b-4b8a-ae96-4068404eb4c6 tempest-AttachVolumeTestJSON-77441230 None] Deleted volume successfully. Jul 21 02:13:33 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f78bea2e-113b-4b8a-ae96-4068404eb4c6 tempest-AttachVolumeTestJSON-77441230 None] Lock "cinder-bbbfd14f-7de3-4273-9f9b-0a4946c11a25-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:33 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a72238d-a18f-4441-9841-b0064600e7e8" returned: 0 in 0.278s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:33 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:13:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21052ea-c35e-42b9-924f-df31927d71d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a72238d-a18f-4441-9841-b0064600e7e8', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3d546fd-ee3f-4c18-afe9-fce13e763fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:33 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] Volume volume-3a72238d-a18f-4441-9841-b0064600e7e8 (3a72238d-a18f-4441-9841-b0064600e7e8): created successfully Jul 21 02:13:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3d546fd-ee3f-4c18-afe9-fce13e763fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] Flow 'volume_create_manager' (e7a79b1e-58d9-42b9-91fe-2fc5e3e5094b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:13:33 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-89f86001-6593-4ee9-89dd-39c5b83f772a tempest-VolumesGetTest-1773935590 None] Created volume successfully. Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] Flow 'volume_create_manager' (a293a613-a944-445a-a6a4-72bfc03a2971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa8d8c9-4e1f-40e9-a048-8791322221eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e66360b1-c750-421f-806a-e0dafd525d56 tempest-AttachVolumeTestJSON-77441230 None] Acquiring lock "cinder-a11ada44-a926-4c24-b76e-33cbb04e91fc-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa8d8c9-4e1f-40e9-a048-8791322221eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2121735469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c36e84f-425b-4d30-90f1-38bb7b2582a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='567996a98e9146488cc42491e804da9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:13:34Z,use_quota=True,user_id='a477da28e00e4a9bbe9c155a45f23ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29a571b7-414f-4158-92f4-aa059443cda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29a571b7-414f-4158-92f4-aa059443cda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c921ffdb-95f0-4c62-8021-2165460cd655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c921ffdb-95f0-4c62-8021-2165460cd655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c36e84f-425b-4d30-90f1-38bb7b2582a1', 'volume_name': 'volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c371be2e-0b0c-4100-8e30-624ed8bf1d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c371be2e-0b0c-4100-8e30-624ed8bf1d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (306eb580-44fe-4e42-b1a4-ce4b0359ff67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:34 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] Volume 3c36e84f-425b-4d30-90f1-38bb7b2582a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1', 'volume_size': 1} Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2121735469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c36e84f-425b-4d30-90f1-38bb7b2582a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='567996a98e9146488cc42491e804da9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:13:34Z,use_quota=True,user_id='a477da28e00e4a9bbe9c155a45f23ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] Creating volume 3c36e84f-425b-4d30-90f1-38bb7b2582a1 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:13:34 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e66360b1-c750-421f-806a-e0dafd525d56 tempest-AttachVolumeTestJSON-77441230 None] Lock "cinder-a11ada44-a926-4c24-b76e-33cbb04e91fc-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:34 devstack sudo[97246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1 1073741824 Jul 21 02:13:34 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e66360b1-c750-421f-806a-e0dafd525d56 tempest-AttachVolumeTestJSON-77441230 None] Acquiring lock "cinder-quobyte-a11ada44-a926-4c24-b76e-33cbb04e91fc" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e66360b1-c750-421f-806a-e0dafd525d56 tempest-AttachVolumeTestJSON-77441230 None] Lock "cinder-quobyte-a11ada44-a926-4c24-b76e-33cbb04e91fc" acquired by "delete_volume" :: waited 0.029s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9ec9ef-e32f-45cb-bf22-f893433f9cc8]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e66360b1-c750-421f-806a-e0dafd525d56 tempest-AttachVolumeTestJSON-77441230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a11ada44-a926-4c24-b76e-33cbb04e91fc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-55f1f3c3-6ddd-4f3c-81f2-f69fff3e1895 tempest-VolumesGetTest-1773935590 None] Acquiring lock "cinder-3a72238d-a18f-4441-9841-b0064600e7e8-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:34 devstack sudo[97250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a11ada44-a926-4c24-b76e-33cbb04e91fc Jul 21 02:13:34 devstack sudo[97250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-55f1f3c3-6ddd-4f3c-81f2-f69fff3e1895 tempest-VolumesGetTest-1773935590 None] Lock "cinder-3a72238d-a18f-4441-9841-b0064600e7e8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-55f1f3c3-6ddd-4f3c-81f2-f69fff3e1895 tempest-VolumesGetTest-1773935590 None] Acquiring lock "cinder-quobyte-3a72238d-a18f-4441-9841-b0064600e7e8" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-55f1f3c3-6ddd-4f3c-81f2-f69fff3e1895 tempest-VolumesGetTest-1773935590 None] Lock "cinder-quobyte-3a72238d-a18f-4441-9841-b0064600e7e8" acquired by "delete_volume" :: waited 0.016s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c5e172-2305-4c8c-983c-c2260bd6f123]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:13:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-55f1f3c3-6ddd-4f3c-81f2-f69fff3e1895 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a72238d-a18f-4441-9841-b0064600e7e8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:35 devstack sudo[97255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a72238d-a18f-4441-9841-b0064600e7e8 Jul 21 02:13:35 devstack sudo[97255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:35 devstack sudo[97250]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e66360b1-c750-421f-806a-e0dafd525d56 tempest-AttachVolumeTestJSON-77441230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a11ada44-a926-4c24-b76e-33cbb04e91fc" returned: 0 in 0.525s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e66360b1-c750-421f-806a-e0dafd525d56 tempest-AttachVolumeTestJSON-77441230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a11ada44-a926-4c24-b76e-33cbb04e91fc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:35 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1 1073741824" returned: 0 in 0.691s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:35 devstack sudo[97261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a11ada44-a926-4c24-b76e-33cbb04e91fc Jul 21 02:13:35 devstack sudo[97261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:35 devstack sudo[97263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1 Jul 21 02:13:35 devstack sudo[97263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:35 devstack sudo[97255]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-55f1f3c3-6ddd-4f3c-81f2-f69fff3e1895 tempest-VolumesGetTest-1773935590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a72238d-a18f-4441-9841-b0064600e7e8" returned: 0 in 0.492s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-55f1f3c3-6ddd-4f3c-81f2-f69fff3e1895 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a72238d-a18f-4441-9841-b0064600e7e8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:35 devstack sudo[97269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a72238d-a18f-4441-9841-b0064600e7e8 Jul 21 02:13:35 devstack sudo[97269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:35 devstack sudo[97261]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e66360b1-c750-421f-806a-e0dafd525d56 tempest-AttachVolumeTestJSON-77441230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a11ada44-a926-4c24-b76e-33cbb04e91fc" returned: 0 in 0.357s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:35 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e66360b1-c750-421f-806a-e0dafd525d56 tempest-AttachVolumeTestJSON-77441230 None] Lock "cinder-quobyte-a11ada44-a926-4c24-b76e-33cbb04e91fc" released by "delete_volume" :: held 0.960s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:35 devstack sudo[97263]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1" returned: 0 in 0.372s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:35 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:13:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:35 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (306eb580-44fe-4e42-b1a4-ce4b0359ff67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:35 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d0ca70-2044-43e6-81e1-56c2f267ede0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:35 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] Volume volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1 (3c36e84f-425b-4d30-90f1-38bb7b2582a1): created successfully Jul 21 02:13:35 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d0ca70-2044-43e6-81e1-56c2f267ede0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:35 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] Flow 'volume_create_manager' (a293a613-a944-445a-a6a4-72bfc03a2971) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:13:35 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-e66360b1-c750-421f-806a-e0dafd525d56 tempest-AttachVolumeTestJSON-77441230 None] Created reservations ['e34feef7-8892-48df-9dff-5bbf69feffdc', '06657f38-e9e0-4aab-8154-7751014bff0d', '7201e034-d9da-48b1-b021-f145237ffd21', 'fec2cfe2-30f0-4c16-a3ea-08c844a79217'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:13:35 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-d341f42f-41b4-470c-922b-f0fac5e9bdd4 tempest-SnapshotsActionsTest-483682043 None] Created volume successfully. Jul 21 02:13:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e66360b1-c750-421f-806a-e0dafd525d56 tempest-AttachVolumeTestJSON-77441230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e66360b1-c750-421f-806a-e0dafd525d56 tempest-AttachVolumeTestJSON-77441230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:35 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e66360b1-c750-421f-806a-e0dafd525d56 tempest-AttachVolumeTestJSON-77441230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:13:35 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e66360b1-c750-421f-806a-e0dafd525d56 tempest-AttachVolumeTestJSON-77441230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:13:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e66360b1-c750-421f-806a-e0dafd525d56 tempest-AttachVolumeTestJSON-77441230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e66360b1-c750-421f-806a-e0dafd525d56 tempest-AttachVolumeTestJSON-77441230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:35 devstack sudo[97269]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-55f1f3c3-6ddd-4f3c-81f2-f69fff3e1895 tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a72238d-a18f-4441-9841-b0064600e7e8" returned: 0 in 0.368s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:35 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-55f1f3c3-6ddd-4f3c-81f2-f69fff3e1895 tempest-VolumesGetTest-1773935590 None] Lock "cinder-quobyte-3a72238d-a18f-4441-9841-b0064600e7e8" released by "delete_volume" :: held 0.912s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:35 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:13:35 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:35 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-55f1f3c3-6ddd-4f3c-81f2-f69fff3e1895 tempest-VolumesGetTest-1773935590 None] Created reservations ['95f97785-f58c-462b-a952-19d3911825c2', '92e5e286-e512-4336-a70b-047c882214c4', '6cfd8ba9-afef-4b83-9bd3-2475106df17b', '40b404b2-cb24-4ccb-bf0d-47a785545490'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:13:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-55f1f3c3-6ddd-4f3c-81f2-f69fff3e1895 tempest-VolumesGetTest-1773935590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-55f1f3c3-6ddd-4f3c-81f2-f69fff3e1895 tempest-VolumesGetTest-1773935590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:35 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-55f1f3c3-6ddd-4f3c-81f2-f69fff3e1895 tempest-VolumesGetTest-1773935590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:13:35 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-55f1f3c3-6ddd-4f3c-81f2-f69fff3e1895 tempest-VolumesGetTest-1773935590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:13:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-55f1f3c3-6ddd-4f3c-81f2-f69fff3e1895 tempest-VolumesGetTest-1773935590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-55f1f3c3-6ddd-4f3c-81f2-f69fff3e1895 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:35 devstack sudo[97276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:13:35 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:36 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e66360b1-c750-421f-806a-e0dafd525d56 tempest-AttachVolumeTestJSON-77441230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.318s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:36 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-e66360b1-c750-421f-806a-e0dafd525d56 tempest-AttachVolumeTestJSON-77441230 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:13:36 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-e66360b1-c750-421f-806a-e0dafd525d56 tempest-AttachVolumeTestJSON-77441230 None] Deleted volume successfully. Jul 21 02:13:36 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e66360b1-c750-421f-806a-e0dafd525d56 tempest-AttachVolumeTestJSON-77441230 None] Lock "cinder-a11ada44-a926-4c24-b76e-33cbb04e91fc-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:36 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-55f1f3c3-6ddd-4f3c-81f2-f69fff3e1895 tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.279s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:36 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-55f1f3c3-6ddd-4f3c-81f2-f69fff3e1895 tempest-VolumesGetTest-1773935590 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:13:36 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-55f1f3c3-6ddd-4f3c-81f2-f69fff3e1895 tempest-VolumesGetTest-1773935590 None] Deleted volume successfully. Jul 21 02:13:36 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-55f1f3c3-6ddd-4f3c-81f2-f69fff3e1895 tempest-VolumesGetTest-1773935590 None] Lock "cinder-3a72238d-a18f-4441-9841-b0064600e7e8-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e2f307d4-94aa-4bc4-88da-241f919fdab1 tempest-SnapshotsActionsTest-483682043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e2f307d4-94aa-4bc4-88da-241f919fdab1 tempest-SnapshotsActionsTest-483682043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:36 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-e2f307d4-94aa-4bc4-88da-241f919fdab1 tempest-SnapshotsActionsTest-483682043 None] Creating offline snapshot af3a7e49-b0a4-4f43-8664-64784deb5205 of volume 3c36e84f-425b-4d30-90f1-38bb7b2582a1 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:13:36 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b8f435-c67e-4498-b827-fb956fd49dd2]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:13:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e2f307d4-94aa-4bc4-88da-241f919fdab1 tempest-SnapshotsActionsTest-483682043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:36 devstack sudo[97293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1 Jul 21 02:13:36 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:37 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e0df0b16-7a28-4024-8d76-caccd5704a85 tempest-VolumesGetTest-1773935590 None] Acquiring lock "cinder-01785306-ecdf-413d-ba11-33ddeac4d025-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:37 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e0df0b16-7a28-4024-8d76-caccd5704a85 tempest-VolumesGetTest-1773935590 None] Lock "cinder-01785306-ecdf-413d-ba11-33ddeac4d025-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:37 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e2f307d4-94aa-4bc4-88da-241f919fdab1 tempest-SnapshotsActionsTest-483682043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1" returned: 0 in 0.498s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e2f307d4-94aa-4bc4-88da-241f919fdab1 tempest-SnapshotsActionsTest-483682043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:37 devstack sudo[97301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 1G Jul 21 02:13:37 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:37 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e0df0b16-7a28-4024-8d76-caccd5704a85 tempest-VolumesGetTest-1773935590 None] Acquiring lock "cinder-quobyte-01785306-ecdf-413d-ba11-33ddeac4d025" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:37 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e0df0b16-7a28-4024-8d76-caccd5704a85 tempest-VolumesGetTest-1773935590 None] Lock "cinder-quobyte-01785306-ecdf-413d-ba11-33ddeac4d025" acquired by "delete_volume" :: waited 0.017s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:37 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ebde3d-2bb1-4f22-9fb2-d51aa15eedd5]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:13:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e0df0b16-7a28-4024-8d76-caccd5704a85 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-01785306-ecdf-413d-ba11-33ddeac4d025 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:37 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-01785306-ecdf-413d-ba11-33ddeac4d025 Jul 21 02:13:37 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:37 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e2f307d4-94aa-4bc4-88da-241f919fdab1 tempest-SnapshotsActionsTest-483682043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 1G" returned: 0 in 0.518s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e2f307d4-94aa-4bc4-88da-241f919fdab1 tempest-SnapshotsActionsTest-483682043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:37 devstack sudo[97312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 Jul 21 02:13:37 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:37 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e0df0b16-7a28-4024-8d76-caccd5704a85 tempest-VolumesGetTest-1773935590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-01785306-ecdf-413d-ba11-33ddeac4d025" returned: 0 in 0.506s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e0df0b16-7a28-4024-8d76-caccd5704a85 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-01785306-ecdf-413d-ba11-33ddeac4d025 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:37 devstack sudo[97314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-01785306-ecdf-413d-ba11-33ddeac4d025 Jul 21 02:13:37 devstack sudo[97314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:38 devstack sudo[97314]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e0df0b16-7a28-4024-8d76-caccd5704a85 tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-01785306-ecdf-413d-ba11-33ddeac4d025" returned: 0 in 0.277s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:38 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e0df0b16-7a28-4024-8d76-caccd5704a85 tempest-VolumesGetTest-1773935590 None] Lock "cinder-quobyte-01785306-ecdf-413d-ba11-33ddeac4d025" released by "delete_volume" :: held 0.834s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:38 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e2f307d4-94aa-4bc4-88da-241f919fdab1 tempest-SnapshotsActionsTest-483682043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205" returned: 0 in 0.391s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:38 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-e2f307d4-94aa-4bc4-88da-241f919fdab1 tempest-SnapshotsActionsTest-483682043 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 is being set with open permissions: ugo+rw Jul 21 02:13:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e2f307d4-94aa-4bc4-88da-241f919fdab1 tempest-SnapshotsActionsTest-483682043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:38 devstack sudo[97320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 Jul 21 02:13:38 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:38 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-e0df0b16-7a28-4024-8d76-caccd5704a85 tempest-VolumesGetTest-1773935590 None] Created reservations ['ff397366-68ed-4307-8923-53d108013623', '9c9c194b-e075-4fdd-9ae1-778a3bd098cf', 'c52d1e0c-a09b-4fa0-8877-a1a16d198c75', 'dd435cea-1fe5-44fa-b7e7-940355a83f22'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:13:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e0df0b16-7a28-4024-8d76-caccd5704a85 tempest-VolumesGetTest-1773935590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e0df0b16-7a28-4024-8d76-caccd5704a85 tempest-VolumesGetTest-1773935590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:38 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e0df0b16-7a28-4024-8d76-caccd5704a85 tempest-VolumesGetTest-1773935590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:13:38 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e0df0b16-7a28-4024-8d76-caccd5704a85 tempest-VolumesGetTest-1773935590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:13:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e0df0b16-7a28-4024-8d76-caccd5704a85 tempest-VolumesGetTest-1773935590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e0df0b16-7a28-4024-8d76-caccd5704a85 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:38 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:13:38 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:38 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e2f307d4-94aa-4bc4-88da-241f919fdab1 tempest-SnapshotsActionsTest-483682043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205" returned: 0 in 0.302s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:38 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a5a63b92-5db5-40c2-8a35-937b70ce993e tempest-VolumesGetTest-1773935590 None] Acquiring lock "cinder-801e744c-df66-47c7-9b97-8771602d208a-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e2f307d4-94aa-4bc4-88da-241f919fdab1 tempest-SnapshotsActionsTest-483682043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:38 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a5a63b92-5db5-40c2-8a35-937b70ce993e tempest-VolumesGetTest-1773935590 None] Lock "cinder-801e744c-df66-47c7-9b97-8771602d208a-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:38 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.info Jul 21 02:13:38 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:38 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a5a63b92-5db5-40c2-8a35-937b70ce993e tempest-VolumesGetTest-1773935590 None] Acquiring lock "cinder-quobyte-801e744c-df66-47c7-9b97-8771602d208a" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:38 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a5a63b92-5db5-40c2-8a35-937b70ce993e tempest-VolumesGetTest-1773935590 None] Lock "cinder-quobyte-801e744c-df66-47c7-9b97-8771602d208a" acquired by "delete_volume" :: waited 0.025s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:38 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6e8605-a280-43f5-9c38-4b62e31a89d1]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:13:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a5a63b92-5db5-40c2-8a35-937b70ce993e tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:38 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e0df0b16-7a28-4024-8d76-caccd5704a85 tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.481s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:38 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-e0df0b16-7a28-4024-8d76-caccd5704a85 tempest-VolumesGetTest-1773935590 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:13:38 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-e0df0b16-7a28-4024-8d76-caccd5704a85 tempest-VolumesGetTest-1773935590 None] Deleted volume successfully. Jul 21 02:13:38 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e0df0b16-7a28-4024-8d76-caccd5704a85 tempest-VolumesGetTest-1773935590 None] Lock "cinder-01785306-ecdf-413d-ba11-33ddeac4d025-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:38 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e2f307d4-94aa-4bc4-88da-241f919fdab1 tempest-SnapshotsActionsTest-483682043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.info" returned: 0 in 0.383s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:38 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-e2f307d4-94aa-4bc4-88da-241f919fdab1 tempest-SnapshotsActionsTest-483682043 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.info is being set with open permissions: ugo+rw Jul 21 02:13:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e2f307d4-94aa-4bc4-88da-241f919fdab1 tempest-SnapshotsActionsTest-483682043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:38 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.info Jul 21 02:13:38 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:38 devstack sudo[97329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a Jul 21 02:13:38 devstack sudo[97329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:39 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e2f307d4-94aa-4bc4-88da-241f919fdab1 tempest-SnapshotsActionsTest-483682043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.info" returned: 0 in 0.300s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e2f307d4-94aa-4bc4-88da-241f919fdab1 tempest-SnapshotsActionsTest-483682043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.572s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:39 devstack sudo[97329]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a5a63b92-5db5-40c2-8a35-937b70ce993e tempest-VolumesGetTest-1773935590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a" returned: 0 in 0.511s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a5a63b92-5db5-40c2-8a35-937b70ce993e tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:39 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-e2f307d4-94aa-4bc4-88da-241f919fdab1 tempest-SnapshotsActionsTest-483682043 None] Create snapshot completed successfully Jul 21 02:13:39 devstack sudo[97339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a Jul 21 02:13:39 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:39 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a5a63b92-5db5-40c2-8a35-937b70ce993e tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-801e744c-df66-47c7-9b97-8771602d208a" returned: 0 in 0.407s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:39 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a5a63b92-5db5-40c2-8a35-937b70ce993e tempest-VolumesGetTest-1773935590 None] Lock "cinder-quobyte-801e744c-df66-47c7-9b97-8771602d208a" released by "delete_volume" :: held 1.055s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:39 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-a5a63b92-5db5-40c2-8a35-937b70ce993e tempest-VolumesGetTest-1773935590 None] Created reservations ['36d284aa-fa54-4f5c-b085-6c19a836300b', 'd4788702-3507-4efa-b3d6-6e4aa40b1ce8', '53dd85cc-d8ed-497f-9877-5ad5a46c6612', '4c6f34b9-b28b-4e55-b1b5-a30d7311792d'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:13:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a5a63b92-5db5-40c2-8a35-937b70ce993e tempest-VolumesGetTest-1773935590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a5a63b92-5db5-40c2-8a35-937b70ce993e tempest-VolumesGetTest-1773935590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:40 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-a5a63b92-5db5-40c2-8a35-937b70ce993e tempest-VolumesGetTest-1773935590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:13:40 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-a5a63b92-5db5-40c2-8a35-937b70ce993e tempest-VolumesGetTest-1773935590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:13:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a5a63b92-5db5-40c2-8a35-937b70ce993e tempest-VolumesGetTest-1773935590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a5a63b92-5db5-40c2-8a35-937b70ce993e tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:40 devstack sudo[97395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:13:40 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:40 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a5a63b92-5db5-40c2-8a35-937b70ce993e tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.588s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:40 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-a5a63b92-5db5-40c2-8a35-937b70ce993e tempest-VolumesGetTest-1773935590 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:13:40 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-a5a63b92-5db5-40c2-8a35-937b70ce993e tempest-VolumesGetTest-1773935590 None] Deleted volume successfully. Jul 21 02:13:40 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a5a63b92-5db5-40c2-8a35-937b70ce993e tempest-VolumesGetTest-1773935590 None] Lock "cinder-801e744c-df66-47c7-9b97-8771602d208a-delete_volume" released by "delete_volume" :: held 2.239s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e5fefcda-7663-4004-9b2a-5af39599901b tempest-SnapshotsActionsTest-483682043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e5fefcda-7663-4004-9b2a-5af39599901b tempest-SnapshotsActionsTest-483682043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:40 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-e5fefcda-7663-4004-9b2a-5af39599901b tempest-SnapshotsActionsTest-483682043 None] Creating offline snapshot e3b4cb9b-f5b5-42d9-988c-43f514c794d4 of volume 3c36e84f-425b-4d30-90f1-38bb7b2582a1 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:13:41 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6693382-60f0-4ad6-a28d-f81e2fdaffc6]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:13:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e5fefcda-7663-4004-9b2a-5af39599901b tempest-SnapshotsActionsTest-483682043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:41 devstack sudo[97411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 Jul 21 02:13:41 devstack sudo[97411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:41 devstack sudo[97411]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e5fefcda-7663-4004-9b2a-5af39599901b tempest-SnapshotsActionsTest-483682043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205" returned: 0 in 0.792s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:41 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-e5fefcda-7663-4004-9b2a-5af39599901b tempest-SnapshotsActionsTest-483682043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:13:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e5fefcda-7663-4004-9b2a-5af39599901b tempest-SnapshotsActionsTest-483682043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.e3b4cb9b-f5b5-42d9-988c-43f514c794d4 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:41 devstack sudo[97419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.e3b4cb9b-f5b5-42d9-988c-43f514c794d4 1G Jul 21 02:13:41 devstack sudo[97419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:42 devstack sudo[97419]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:42 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:13:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Flow 'volume_create_manager' (d873e4cd-0426-4b6c-ac7d-4209c4c2587c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:13:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (792c4a4c-9c6f-4362-b826-9125ce75d22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e5fefcda-7663-4004-9b2a-5af39599901b tempest-SnapshotsActionsTest-483682043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.e3b4cb9b-f5b5-42d9-988c-43f514c794d4 1G" returned: 0 in 0.726s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e5fefcda-7663-4004-9b2a-5af39599901b tempest-SnapshotsActionsTest-483682043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.e3b4cb9b-f5b5-42d9-988c-43f514c794d4 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (792c4a4c-9c6f-4362-b826-9125ce75d22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:13:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-552348048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c303c953-d208-424b-a091-7441a72fd2ba,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='59682f03e56f442a95b488e6ada71d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:13:42Z,use_quota=True,user_id='4b359d60f98340a3a412c9a72404c995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:42 devstack sudo[97426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.e3b4cb9b-f5b5-42d9-988c-43f514c794d4 Jul 21 02:13:42 devstack sudo[97426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (665e4be9-0a08-45d0-a9a9-08959be0ffa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (665e4be9-0a08-45d0-a9a9-08959be0ffa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff7c435-9590-4927-8d70-0b37f1423c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:42 devstack cinder-volume[87566]: DEBUG cinder.image.glance [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Creating Keystone auth plugin from conf {{(pid=87566) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 02:13:43 devstack sudo[97426]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e5fefcda-7663-4004-9b2a-5af39599901b tempest-SnapshotsActionsTest-483682043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.e3b4cb9b-f5b5-42d9-988c-43f514c794d4" returned: 0 in 0.555s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:43 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-e5fefcda-7663-4004-9b2a-5af39599901b tempest-SnapshotsActionsTest-483682043 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.e3b4cb9b-f5b5-42d9-988c-43f514c794d4 is being set with open permissions: ugo+rw Jul 21 02:13:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e5fefcda-7663-4004-9b2a-5af39599901b tempest-SnapshotsActionsTest-483682043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.e3b4cb9b-f5b5-42d9-988c-43f514c794d4 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:43 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.e3b4cb9b-f5b5-42d9-988c-43f514c794d4 Jul 21 02:13:43 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:43 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff7c435-9590-4927-8d70-0b37f1423c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c303c953-d208-424b-a091-7441a72fd2ba', 'volume_name': 'volume-c303c953-d208-424b-a091-7441a72fd2ba', 'volume_size': 1, 'image_id': '5de785ea-426a-4934-a69a-ddf7f2aebea6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5de785ea-426a-4934-a69a-ddf7f2aebea6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a8e154f63094b778a262349ffd9723e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5de785ea-426a-4934-a69a-ddf7f2aebea6', 'created_at': datetime.datetime(2026, 7, 21, 0, 0, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 0, 0, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5de785ea-426a-4934-a69a-ddf7f2aebea6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:43 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f062342-d68e-4b32-9eed-e0c6d6a4a4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:43 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f062342-d68e-4b32-9eed-e0c6d6a4a4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:43 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcdfe0de-5a09-4bd3-84d4-2811d6e82c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:43 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Volume c303c953-d208-424b-a091-7441a72fd2ba: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c303c953-d208-424b-a091-7441a72fd2ba', 'volume_size': 1, 'image_id': '5de785ea-426a-4934-a69a-ddf7f2aebea6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5de785ea-426a-4934-a69a-ddf7f2aebea6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a8e154f63094b778a262349ffd9723e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5de785ea-426a-4934-a69a-ddf7f2aebea6', 'created_at': datetime.datetime(2026, 7, 21, 0, 0, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 0, 0, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5de785ea-426a-4934-a69a-ddf7f2aebea6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 21 02:13:43 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Trying to clone c303c953-d208-424b-a091-7441a72fd2ba from image 5de785ea-426a-4934-a69a-ddf7f2aebea6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5de785ea-426a-4934-a69a-ddf7f2aebea6', 'metadata': {}}]). {{(pid=87566) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 02:13:43 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e5fefcda-7663-4004-9b2a-5af39599901b tempest-SnapshotsActionsTest-483682043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.e3b4cb9b-f5b5-42d9-988c-43f514c794d4" returned: 0 in 0.394s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e5fefcda-7663-4004-9b2a-5af39599901b tempest-SnapshotsActionsTest-483682043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.659s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:43 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-e5fefcda-7663-4004-9b2a-5af39599901b tempest-SnapshotsActionsTest-483682043 None] Create snapshot completed successfully Jul 21 02:13:43 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-5d9dac8f-a8c5-43b3-a3a0-81ecc4af2cfc tempest-VolumesActionsTest-1474695972 None] Acquiring lock "cinder-683285b7-a02c-4fcd-bc2c-abbfcb02905f" by "attach_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:43 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-5d9dac8f-a8c5-43b3-a3a0-81ecc4af2cfc tempest-VolumesActionsTest-1474695972 None] Lock "cinder-683285b7-a02c-4fcd-bc2c-abbfcb02905f" acquired by "attach_volume" :: waited 0.049s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:43 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_s_wb5bmpdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87566) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 02:13:43 devstack cinder-volume[87566]: INFO cinder.image.image_utils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Image download 20.69 MB at 20.69 MB/s Jul 21 02:13:43 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-5d9dac8f-a8c5-43b3-a3a0-81ecc4af2cfc tempest-VolumesActionsTest-1474695972 None] Attaching volume 683285b7-a02c-4fcd-bc2c-abbfcb02905f to instance 11d39e71-7737-437b-b38c-4d04e6ee4c3c at mountpoint /dev/vdb on host None. Jul 21 02:13:44 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-5d9dac8f-a8c5-43b3-a3a0-81ecc4af2cfc tempest-VolumesActionsTest-1474695972 None] Attach volume completed successfully. Jul 21 02:13:44 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2bfa2a-ae30-4caa-bbdc-021716959aee]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:13:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_s_wb5bmpdevstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:44 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-5d9dac8f-a8c5-43b3-a3a0-81ecc4af2cfc tempest-VolumesActionsTest-1474695972 None] Lock "cinder-683285b7-a02c-4fcd-bc2c-abbfcb02905f" released by "attach_volume" :: held 0.315s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:44 devstack sudo[97437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_s_wb5bmpdevstack@QuobyteHD Jul 21 02:13:44 devstack sudo[97437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:44 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-26395d0b-216d-41d5-895b-70c580048118 tempest-SnapshotsActionsTest-1307534859 None] Acquiring lock "cinder-e3b4cb9b-f5b5-42d9-988c-43f514c794d4-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:44 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-26395d0b-216d-41d5-895b-70c580048118 tempest-SnapshotsActionsTest-1307534859 None] Lock "cinder-e3b4cb9b-f5b5-42d9-988c-43f514c794d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:44 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-26395d0b-216d-41d5-895b-70c580048118 tempest-SnapshotsActionsTest-1307534859 None] Acquiring lock "cinder-quobyte-3c36e84f-425b-4d30-90f1-38bb7b2582a1" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:44 devstack sudo[97437]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_s_wb5bmpdevstack@QuobyteHD" returned: 0 in 0.453s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:44 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Temporary image 5de785ea-426a-4934-a69a-ddf7f2aebea6 is fetched for user 4b359d60f98340a3a412c9a72404c995. {{(pid=87566) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 02:13:44 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-26395d0b-216d-41d5-895b-70c580048118 tempest-SnapshotsActionsTest-1307534859 None] Lock "cinder-quobyte-3c36e84f-425b-4d30-90f1-38bb7b2582a1" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:44 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-26395d0b-216d-41d5-895b-70c580048118 tempest-SnapshotsActionsTest-1307534859 None] Acquiring lock "cinder-quobyte-e3b4cb9b-f5b5-42d9-988c-43f514c794d4" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:44 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-26395d0b-216d-41d5-895b-70c580048118 tempest-SnapshotsActionsTest-1307534859 None] Lock "cinder-quobyte-e3b4cb9b-f5b5-42d9-988c-43f514c794d4" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:44 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-26395d0b-216d-41d5-895b-70c580048118 tempest-SnapshotsActionsTest-1307534859 None] Deleting offline snapshot e3b4cb9b-f5b5-42d9-988c-43f514c794d4 of volume 3c36e84f-425b-4d30-90f1-38bb7b2582a1 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:13:44 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-26395d0b-216d-41d5-895b-70c580048118 tempest-SnapshotsActionsTest-1307534859 None] snapshot_file for this snap is: volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.e3b4cb9b-f5b5-42d9-988c-43f514c794d4 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:13:44 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1c48e0fc-23ac-4d89-823b-59f9911e7ee6 tempest-VolumesActionsTest-1474695972 None] Acquiring lock "cinder-683285b7-a02c-4fcd-bc2c-abbfcb02905f-detach_volume" by "detach_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:44 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7db65f5-918f-4c4d-8376-f18162a2d02d]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:13:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-26395d0b-216d-41d5-895b-70c580048118 tempest-SnapshotsActionsTest-1307534859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.e3b4cb9b-f5b5-42d9-988c-43f514c794d4 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:44 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1c48e0fc-23ac-4d89-823b-59f9911e7ee6 tempest-VolumesActionsTest-1474695972 None] Lock "cinder-683285b7-a02c-4fcd-bc2c-abbfcb02905f-detach_volume" acquired by "detach_volume" :: waited 0.055s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:44 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-1c48e0fc-23ac-4d89-823b-59f9911e7ee6 tempest-VolumesActionsTest-1474695972 None] Detaching volume 683285b7-a02c-4fcd-bc2c-abbfcb02905f from instance 11d39e71-7737-437b-b38c-4d04e6ee4c3c. Jul 21 02:13:44 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d84152c-7e0c-4a96-b23a-3a54e2b63021]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:13:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_s_wb5bmpdevstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:44 devstack sudo[97443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.e3b4cb9b-f5b5-42d9-988c-43f514c794d4 Jul 21 02:13:44 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:44 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-1c48e0fc-23ac-4d89-823b-59f9911e7ee6 tempest-VolumesActionsTest-1474695972 None] Detach volume completed successfully. Jul 21 02:13:44 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1c48e0fc-23ac-4d89-823b-59f9911e7ee6 tempest-VolumesActionsTest-1474695972 None] Lock "cinder-683285b7-a02c-4fcd-bc2c-abbfcb02905f-detach_volume" released by "detach_volume" :: held 0.158s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:44 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_s_wb5bmpdevstack@QuobyteHD Jul 21 02:13:44 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:45 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_s_wb5bmpdevstack@QuobyteHD" returned: 0 in 0.488s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:45 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:13:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-552348048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c303c953-d208-424b-a091-7441a72fd2ba,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='59682f03e56f442a95b488e6ada71d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:13:42Z,use_quota=True,user_id='4b359d60f98340a3a412c9a72404c995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:13:45 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Creating volume c303c953-d208-424b-a091-7441a72fd2ba {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:13:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:45 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:13:45 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:13:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:45 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:13:45 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:13:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c303c953-d208-424b-a091-7441a72fd2ba 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:45 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-26395d0b-216d-41d5-895b-70c580048118 tempest-SnapshotsActionsTest-1307534859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.e3b4cb9b-f5b5-42d9-988c-43f514c794d4" returned: 0 in 0.591s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:45 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-26395d0b-216d-41d5-895b-70c580048118 tempest-SnapshotsActionsTest-1307534859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:13:45 devstack sudo[97454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c303c953-d208-424b-a091-7441a72fd2ba 1073741824 Jul 21 02:13:45 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:45 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a105fd5-b52c-4faf-9ea5-e9e8cecbd349]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:13:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-26395d0b-216d-41d5-895b-70c580048118 tempest-SnapshotsActionsTest-1307534859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:45 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 Jul 21 02:13:45 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:45 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:45 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-26395d0b-216d-41d5-895b-70c580048118 tempest-SnapshotsActionsTest-1307534859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205" returned: 0 in 0.729s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:45 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-26395d0b-216d-41d5-895b-70c580048118 tempest-SnapshotsActionsTest-1307534859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:13:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-26395d0b-216d-41d5-895b-70c580048118 tempest-SnapshotsActionsTest-1307534859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.e3b4cb9b-f5b5-42d9-988c-43f514c794d4 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c303c953-d208-424b-a091-7441a72fd2ba 1073741824" returned: 0 in 0.827s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:46 devstack sudo[97483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.e3b4cb9b-f5b5-42d9-988c-43f514c794d4 Jul 21 02:13:46 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c303c953-d208-424b-a091-7441a72fd2ba {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:46 devstack sudo[97487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c303c953-d208-424b-a091-7441a72fd2ba Jul 21 02:13:46 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:46 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c303c953-d208-424b-a091-7441a72fd2ba" returned: 0 in 0.375s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:13:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:46 devstack cinder-volume[87566]: DEBUG cinder.volume.volume_utils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Attempting download of 5de785ea-426a-4934-a69a-ddf7f2aebea6 ((None, [{'url': 'file:///opt/stack/data/glance/images/5de785ea-426a-4934-a69a-ddf7f2aebea6', 'metadata': {}}])) to volume c303c953-d208-424b-a091-7441a72fd2ba. {{(pid=87566) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 02:13:46 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-26395d0b-216d-41d5-895b-70c580048118 tempest-SnapshotsActionsTest-1307534859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.e3b4cb9b-f5b5-42d9-988c-43f514c794d4" returned: 0 in 0.526s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-26395d0b-216d-41d5-895b-70c580048118 tempest-SnapshotsActionsTest-1307534859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.e3b4cb9b-f5b5-42d9-988c-43f514c794d4 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:46 devstack sudo[97494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.e3b4cb9b-f5b5-42d9-988c-43f514c794d4 Jul 21 02:13:46 devstack sudo[97494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:46 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84278ad-4647-4f5d-afa0-20003590e59d]: (4, 'raw') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:13:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5de785ea-426a-4934-a69a-ddf7f2aebea6_v12agr5b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:46 devstack sudo[97496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5de785ea-426a-4934-a69a-ddf7f2aebea6_v12agr5b Jul 21 02:13:46 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:46 devstack sudo[97494]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-26395d0b-216d-41d5-895b-70c580048118 tempest-SnapshotsActionsTest-1307534859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.e3b4cb9b-f5b5-42d9-988c-43f514c794d4" returned: 0 in 0.446s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:46 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-26395d0b-216d-41d5-895b-70c580048118 tempest-SnapshotsActionsTest-1307534859 None] Lock "cinder-quobyte-e3b4cb9b-f5b5-42d9-988c-43f514c794d4" released by "_delete_snapshot" :: held 2.463s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-26395d0b-216d-41d5-895b-70c580048118 tempest-SnapshotsActionsTest-1307534859 None] Lock "cinder-quobyte-3c36e84f-425b-4d30-90f1-38bb7b2582a1" released by "delete_snapshot" :: held 2.498s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:47 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-26395d0b-216d-41d5-895b-70c580048118 tempest-SnapshotsActionsTest-1307534859 None] Created reservations ['2bc8e3a7-47a6-4680-9186-627db2d82c54', '9217dea9-7d21-4653-ae2e-f850c185f6f6', '9f40880a-4639-4fb6-b1a8-50ac9d83e48f', '355ceb04-435f-43e1-aed8-b81a829cf0b9'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:13:47 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-26395d0b-216d-41d5-895b-70c580048118 tempest-SnapshotsActionsTest-1307534859 None] Delete snapshot completed successfully. Jul 21 02:13:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-26395d0b-216d-41d5-895b-70c580048118 tempest-SnapshotsActionsTest-1307534859 None] Lock "cinder-e3b4cb9b-f5b5-42d9-988c-43f514c794d4-delete_snapshot" released by "delete_snapshot" :: held 2.690s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:47 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5de785ea-426a-4934-a69a-ddf7f2aebea6_v12agr5b" returned: 0 in 0.603s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5de785ea-426a-4934-a69a-ddf7f2aebea6_v12agr5b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:47 devstack sudo[97503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5de785ea-426a-4934-a69a-ddf7f2aebea6_v12agr5b Jul 21 02:13:47 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:47 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5de785ea-426a-4934-a69a-ddf7f2aebea6_v12agr5b" returned: 1 in 0.362s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5de785ea-426a-4934-a69a-ddf7f2aebea6_v12agr5b' failed. Not Retrying. {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 02:13:47 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f60ece1-acd6-4ec6-b567-cbdb1f897de3]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:13:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_s_wb5bmpdevstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:47 devstack sudo[97507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_s_wb5bmpdevstack@QuobyteHD Jul 21 02:13:47 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:47 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:13:47 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] Flow 'volume_create_manager' (3fb88b3c-1b45-47b5-b993-ca4c39b8a789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:13:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f0fa6e-4b41-4cc2-9d60-0578aa305be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_s_wb5bmpdevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] 5de785ea-426a-4934-a69a-ddf7f2aebea6 was qcow2, converting to qcow2 {{(pid=87566) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_s_wb5bmpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c303c953-d208-424b-a091-7441a72fd2ba {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f0fa6e-4b41-4cc2-9d60-0578aa305be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-181028777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e405af-e0b2-4cf4-a0e8-8dbffa6b351d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7b6aa09893c64b05a9b477d5ba84f890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:13:48Z,use_quota=True,user_id='3afcfaf4e50c40139be1d679103db1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:48 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_s_wb5bmpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c303c953-d208-424b-a091-7441a72fd2ba Jul 21 02:13:48 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b3dbe4a-1be1-497e-9de6-896c61d713d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b3dbe4a-1be1-497e-9de6-896c61d713d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (666cf435-f0e5-4586-be81-476c9da020b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (666cf435-f0e5-4586-be81-476c9da020b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77e405af-e0b2-4cf4-a0e8-8dbffa6b351d', 'volume_name': 'volume-77e405af-e0b2-4cf4-a0e8-8dbffa6b351d', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8734d17-5587-4100-a720-d85c5914e4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8734d17-5587-4100-a720-d85c5914e4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b0d2fb3-c99e-44ba-a991-53e77ccac737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:48 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] Volume 77e405af-e0b2-4cf4-a0e8-8dbffa6b351d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77e405af-e0b2-4cf4-a0e8-8dbffa6b351d', 'volume_size': 1} Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-181028777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e405af-e0b2-4cf4-a0e8-8dbffa6b351d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7b6aa09893c64b05a9b477d5ba84f890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:13:48Z,use_quota=True,user_id='3afcfaf4e50c40139be1d679103db1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] Creating volume 77e405af-e0b2-4cf4-a0e8-8dbffa6b351d {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:13:48 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-77e405af-e0b2-4cf4-a0e8-8dbffa6b351d 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9a9d1106-7df8-4779-94ed-e7e82c3cd3ed tempest-SnapshotsActionsTest-483682043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:48 devstack sudo[97515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-77e405af-e0b2-4cf4-a0e8-8dbffa6b351d 1073741824 Jul 21 02:13:48 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:48 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-77e405af-e0b2-4cf4-a0e8-8dbffa6b351d 1073741824" returned: 0 in 0.476s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-77e405af-e0b2-4cf4-a0e8-8dbffa6b351d {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:48 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-77e405af-e0b2-4cf4-a0e8-8dbffa6b351d Jul 21 02:13:48 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:48 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-77e405af-e0b2-4cf4-a0e8-8dbffa6b351d" returned: 0 in 0.306s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:48 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:13:48 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9a9d1106-7df8-4779-94ed-e7e82c3cd3ed tempest-SnapshotsActionsTest-483682043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.799s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b0d2fb3-c99e-44ba-a991-53e77ccac737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77e405af-e0b2-4cf4-a0e8-8dbffa6b351d', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caf11637-bc2c-4560-9cc4-9abee14dcb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-9a9d1106-7df8-4779-94ed-e7e82c3cd3ed tempest-SnapshotsActionsTest-483682043 None] Creating offline snapshot 09cef5ed-8abf-4356-b700-87704f84df11 of volume 3c36e84f-425b-4d30-90f1-38bb7b2582a1 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:13:49 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] Volume volume-77e405af-e0b2-4cf4-a0e8-8dbffa6b351d (77e405af-e0b2-4cf4-a0e8-8dbffa6b351d): created successfully Jul 21 02:13:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caf11637-bc2c-4560-9cc4-9abee14dcb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] Flow 'volume_create_manager' (3fb88b3c-1b45-47b5-b993-ca4c39b8a789) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:13:49 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe01ad63-fedf-48bd-b32b-071832c61606]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:13:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9a9d1106-7df8-4779-94ed-e7e82c3cd3ed tempest-SnapshotsActionsTest-483682043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:49 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-e559ffd6-6e77-4907-a2a1-c49486036017 tempest-VolumesTestJSON-1245641136 None] Created volume successfully. Jul 21 02:13:49 devstack sudo[97531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 Jul 21 02:13:49 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:49 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.354s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:49 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:13:49 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager._thread_info {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:13:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread count: 28 {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 02:13:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread info: [<_MainThread(MainThread, started 135786703114368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 02:13:49 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9a9d1106-7df8-4779-94ed-e7e82c3cd3ed tempest-SnapshotsActionsTest-483682043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205" returned: 0 in 0.462s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-9a9d1106-7df8-4779-94ed-e7e82c3cd3ed tempest-SnapshotsActionsTest-483682043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:13:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9a9d1106-7df8-4779-94ed-e7e82c3cd3ed tempest-SnapshotsActionsTest-483682043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.09cef5ed-8abf-4356-b700-87704f84df11 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:49 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.09cef5ed-8abf-4356-b700-87704f84df11 1G Jul 21 02:13:49 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:50 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ef1d01cf-8507-4217-88a6-d43c7e9032f0 tempest-VolumesActionsTest-1474695972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_s_wb5bmpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c303c953-d208-424b-a091-7441a72fd2ba" returned: 0 in 2.049s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_s_wb5bmpdevstack@QuobyteHD, size 112.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c303c953-d208-424b-a091-7441a72fd2ba {{(pid=87566) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 02:13:50 devstack cinder-volume[87566]: INFO cinder.image.image_utils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Converted 112.00 MB image at 54.63 MB/s Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c303c953-d208-424b-a091-7441a72fd2ba 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:50 devstack sudo[97578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c303c953-d208-424b-a091-7441a72fd2ba 1G Jul 21 02:13:50 devstack sudo[97578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:50 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9a9d1106-7df8-4779-94ed-e7e82c3cd3ed tempest-SnapshotsActionsTest-483682043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.09cef5ed-8abf-4356-b700-87704f84df11 1G" returned: 0 in 0.664s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9a9d1106-7df8-4779-94ed-e7e82c3cd3ed tempest-SnapshotsActionsTest-483682043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.09cef5ed-8abf-4356-b700-87704f84df11 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:50 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.09cef5ed-8abf-4356-b700-87704f84df11 Jul 21 02:13:50 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:50 devstack sudo[97578]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c303c953-d208-424b-a091-7441a72fd2ba 1G" returned: 0 in 0.430s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG cinder.volume.volume_utils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Downloaded image 5de785ea-426a-4934-a69a-ddf7f2aebea6 ((None, [{'url': 'file:///opt/stack/data/glance/images/5de785ea-426a-4934-a69a-ddf7f2aebea6', 'metadata': {}}])) to volume c303c953-d208-424b-a091-7441a72fd2ba successfully. {{(pid=87566) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Temporary image 5de785ea-426a-4934-a69a-ddf7f2aebea6 for user 4b359d60f98340a3a412c9a72404c995 is deleted. {{(pid=87566) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG cinder.volume.volume_utils [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Marking volume c303c953-d208-424b-a091-7441a72fd2ba as bootable. {{(pid=87566) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Copying metadata from image 5de785ea-426a-4934-a69a-ddf7f2aebea6 to c303c953-d208-424b-a091-7441a72fd2ba. {{(pid=87566) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Creating volume glance metadata for volume c303c953-d208-424b-a091-7441a72fd2ba backed by image 5de785ea-426a-4934-a69a-ddf7f2aebea6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5de785ea-426a-4934-a69a-ddf7f2aebea6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87566) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 02:13:50 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9a9d1106-7df8-4779-94ed-e7e82c3cd3ed tempest-SnapshotsActionsTest-483682043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.09cef5ed-8abf-4356-b700-87704f84df11" returned: 0 in 0.376s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:50 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-9a9d1106-7df8-4779-94ed-e7e82c3cd3ed tempest-SnapshotsActionsTest-483682043 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.09cef5ed-8abf-4356-b700-87704f84df11 is being set with open permissions: ugo+rw Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9a9d1106-7df8-4779-94ed-e7e82c3cd3ed tempest-SnapshotsActionsTest-483682043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.09cef5ed-8abf-4356-b700-87704f84df11 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:50 devstack sudo[97592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.09cef5ed-8abf-4356-b700-87704f84df11 Jul 21 02:13:50 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcdfe0de-5a09-4bd3-84d4-2811d6e82c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c303c953-d208-424b-a091-7441a72fd2ba', 'volume_size': 1, 'image_id': '5de785ea-426a-4934-a69a-ddf7f2aebea6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5de785ea-426a-4934-a69a-ddf7f2aebea6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a8e154f63094b778a262349ffd9723e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5de785ea-426a-4934-a69a-ddf7f2aebea6', 'created_at': datetime.datetime(2026, 7, 21, 0, 0, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 0, 0, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5de785ea-426a-4934-a69a-ddf7f2aebea6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f95ac9d-9316-423c-8ca7-709581e19274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:50 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Volume volume-c303c953-d208-424b-a091-7441a72fd2ba (c303c953-d208-424b-a091-7441a72fd2ba): created successfully Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f95ac9d-9316-423c-8ca7-709581e19274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Flow 'volume_create_manager' (d873e4cd-0426-4b6c-ac7d-4209c4c2587c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:13:50 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-8e6c5df1-ea7c-4221-b986-4893c9a842d6 tempest-VolumesGetTest-1773935590 None] Created volume successfully. Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] Flow 'volume_create_manager' (9daa8212-09ee-467b-b1ed-48c7259fa620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04472803-f607-4cb2-9ce4-d6add50cd803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04472803-f607-4cb2-9ce4-d6add50cd803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-820449715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22fd9ac0-03bc-4957-9053-fea527344d16,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7b6aa09893c64b05a9b477d5ba84f890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:13:51Z,use_quota=True,user_id='3afcfaf4e50c40139be1d679103db1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c7f157-224f-44b0-9349-b06345c1131d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c7f157-224f-44b0-9349-b06345c1131d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc08fd23-fa1c-4178-a41f-d643f7c28203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc08fd23-fa1c-4178-a41f-d643f7c28203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22fd9ac0-03bc-4957-9053-fea527344d16', 'volume_name': 'volume-22fd9ac0-03bc-4957-9053-fea527344d16', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c493b49-8a3c-44f5-b8e3-c8c0bda4c950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c493b49-8a3c-44f5-b8e3-c8c0bda4c950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1088b960-1434-4cb3-9e0d-128e6e314626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:50 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] Volume 22fd9ac0-03bc-4957-9053-fea527344d16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22fd9ac0-03bc-4957-9053-fea527344d16', 'volume_size': 1} Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:50 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9a9d1106-7df8-4779-94ed-e7e82c3cd3ed tempest-SnapshotsActionsTest-483682043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.09cef5ed-8abf-4356-b700-87704f84df11" returned: 0 in 0.253s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9a9d1106-7df8-4779-94ed-e7e82c3cd3ed tempest-SnapshotsActionsTest-483682043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.900s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ef1d01cf-8507-4217-88a6-d43c7e9032f0 tempest-VolumesActionsTest-1474695972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.765s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[179f94b5-b9aa-4372-bec7-f4309c23ab3b]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:13:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ef1d01cf-8507-4217-88a6-d43c7e9032f0 tempest-VolumesActionsTest-1474695972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:50 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-9a9d1106-7df8-4779-94ed-e7e82c3cd3ed tempest-SnapshotsActionsTest-483682043 None] Create snapshot completed successfully Jul 21 02:13:50 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f Jul 21 02:13:50 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:51 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ef1d01cf-8507-4217-88a6-d43c7e9032f0 tempest-VolumesActionsTest-1474695972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f" returned: 0 in 0.396s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:51 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a7955f-ffd9-46aa-9d63-110876800b32]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:13:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ef1d01cf-8507-4217-88a6-d43c7e9032f0 tempest-VolumesActionsTest-1474695972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:51 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2f78ccd6-f0fb-41dc-b90a-f1e8499ef9f8 tempest-SnapshotsActionsTest-1307534859 None] Acquiring lock "cinder-09cef5ed-8abf-4356-b700-87704f84df11-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:51 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2f78ccd6-f0fb-41dc-b90a-f1e8499ef9f8 tempest-SnapshotsActionsTest-1307534859 None] Lock "cinder-09cef5ed-8abf-4356-b700-87704f84df11-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:51 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2f78ccd6-f0fb-41dc-b90a-f1e8499ef9f8 tempest-SnapshotsActionsTest-1307534859 None] Acquiring lock "cinder-quobyte-3c36e84f-425b-4d30-90f1-38bb7b2582a1" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:51 devstack sudo[97600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f Jul 21 02:13:51 devstack sudo[97600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:51 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2f78ccd6-f0fb-41dc-b90a-f1e8499ef9f8 tempest-SnapshotsActionsTest-1307534859 None] Lock "cinder-quobyte-3c36e84f-425b-4d30-90f1-38bb7b2582a1" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:51 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2f78ccd6-f0fb-41dc-b90a-f1e8499ef9f8 tempest-SnapshotsActionsTest-1307534859 None] Acquiring lock "cinder-quobyte-09cef5ed-8abf-4356-b700-87704f84df11" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:13:51 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2f78ccd6-f0fb-41dc-b90a-f1e8499ef9f8 tempest-SnapshotsActionsTest-1307534859 None] Lock "cinder-quobyte-09cef5ed-8abf-4356-b700-87704f84df11" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:13:51 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-2f78ccd6-f0fb-41dc-b90a-f1e8499ef9f8 tempest-SnapshotsActionsTest-1307534859 None] Deleting offline snapshot 09cef5ed-8abf-4356-b700-87704f84df11 of volume 3c36e84f-425b-4d30-90f1-38bb7b2582a1 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:13:51 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-2f78ccd6-f0fb-41dc-b90a-f1e8499ef9f8 tempest-SnapshotsActionsTest-1307534859 None] snapshot_file for this snap is: volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.09cef5ed-8abf-4356-b700-87704f84df11 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:13:51 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc291b20-21ff-469c-ab18-83e23b6e7535]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:13:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2f78ccd6-f0fb-41dc-b90a-f1e8499ef9f8 tempest-SnapshotsActionsTest-1307534859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.09cef5ed-8abf-4356-b700-87704f84df11 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:51 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.09cef5ed-8abf-4356-b700-87704f84df11 Jul 21 02:13:51 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:51 devstack sudo[97600]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ef1d01cf-8507-4217-88a6-d43c7e9032f0 tempest-VolumesActionsTest-1474695972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f" returned: 0 in 0.392s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ef1d01cf-8507-4217-88a6-d43c7e9032f0 tempest-VolumesActionsTest-1474695972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f /opt/stack/data/cinder/conversion/683285b7-a02c-4fcd-bc2c-abbfcb02905f.temp_image.c47b2f7c-6c77-443d-bd61-2c8f05a8c4722_88cqo3.img {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:51 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f /opt/stack/data/cinder/conversion/683285b7-a02c-4fcd-bc2c-abbfcb02905f.temp_image.c47b2f7c-6c77-443d-bd61-2c8f05a8c4722_88cqo3.img Jul 21 02:13:51 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:51 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2f78ccd6-f0fb-41dc-b90a-f1e8499ef9f8 tempest-SnapshotsActionsTest-1307534859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.09cef5ed-8abf-4356-b700-87704f84df11" returned: 0 in 0.388s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:51 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-2f78ccd6-f0fb-41dc-b90a-f1e8499ef9f8 tempest-SnapshotsActionsTest-1307534859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:13:51 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad86f16d-483c-4f3b-8e03-00d59d68945e]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:13:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2f78ccd6-f0fb-41dc-b90a-f1e8499ef9f8 tempest-SnapshotsActionsTest-1307534859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:52 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:13:52 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] Flow 'volume_create_manager' (8c508b1e-b0f8-442f-9a02-fcb5299bca1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:13:52 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fba07b0-cd59-4ea5-b199-a499a24a83ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:52 devstack sudo[97614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 Jul 21 02:13:52 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fba07b0-cd59-4ea5-b199-a499a24a83ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:13:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-314305963',display_name='tempest-VolumesGetTest-Volume-1502820081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af8270b0-acc5-4f83-b49d-02ad0ee4f635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59682f03e56f442a95b488e6ada71d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:13:52Z,use_quota=True,user_id='4b359d60f98340a3a412c9a72404c995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:52 devstack sudo[97614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:52 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c05dad-9f12-49c3-9170-c9a9e5ddf059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:52 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c05dad-9f12-49c3-9170-c9a9e5ddf059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:52 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09f2e651-3409-4379-82bf-0cd1d05ded6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:52 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09f2e651-3409-4379-82bf-0cd1d05ded6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af8270b0-acc5-4f83-b49d-02ad0ee4f635', 'volume_name': 'volume-af8270b0-acc5-4f83-b49d-02ad0ee4f635', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:52 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c39d533-4b04-4e8c-927d-fe50e195eb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:52 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c39d533-4b04-4e8c-927d-fe50e195eb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:13:52 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313d0164-a714-40b0-ab0c-4c3a073e217e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:13:52 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] Volume af8270b0-acc5-4f83-b49d-02ad0ee4f635: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af8270b0-acc5-4f83-b49d-02ad0ee4f635', 'volume_size': 1} Jul 21 02:13:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:53 devstack sudo[97614]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2f78ccd6-f0fb-41dc-b90a-f1e8499ef9f8 tempest-SnapshotsActionsTest-1307534859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205" returned: 0 in 1.134s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-2f78ccd6-f0fb-41dc-b90a-f1e8499ef9f8 tempest-SnapshotsActionsTest-1307534859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:13:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2f78ccd6-f0fb-41dc-b90a-f1e8499ef9f8 tempest-SnapshotsActionsTest-1307534859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.09cef5ed-8abf-4356-b700-87704f84df11 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:53 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.09cef5ed-8abf-4356-b700-87704f84df11 Jul 21 02:13:53 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:53 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2f78ccd6-f0fb-41dc-b90a-f1e8499ef9f8 tempest-SnapshotsActionsTest-1307534859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.09cef5ed-8abf-4356-b700-87704f84df11" returned: 0 in 0.714s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2f78ccd6-f0fb-41dc-b90a-f1e8499ef9f8 tempest-SnapshotsActionsTest-1307534859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.09cef5ed-8abf-4356-b700-87704f84df11 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:53 devstack sudo[97634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.09cef5ed-8abf-4356-b700-87704f84df11 Jul 21 02:13:53 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:54 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2f78ccd6-f0fb-41dc-b90a-f1e8499ef9f8 tempest-SnapshotsActionsTest-1307534859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.09cef5ed-8abf-4356-b700-87704f84df11" returned: 0 in 0.482s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2f78ccd6-f0fb-41dc-b90a-f1e8499ef9f8 tempest-SnapshotsActionsTest-1307534859 None] Lock "cinder-quobyte-09cef5ed-8abf-4356-b700-87704f84df11" released by "_delete_snapshot" :: held 2.897s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2f78ccd6-f0fb-41dc-b90a-f1e8499ef9f8 tempest-SnapshotsActionsTest-1307534859 None] Lock "cinder-quobyte-3c36e84f-425b-4d30-90f1-38bb7b2582a1" released by "delete_snapshot" :: held 2.946s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:54 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-2f78ccd6-f0fb-41dc-b90a-f1e8499ef9f8 tempest-SnapshotsActionsTest-1307534859 None] Created reservations ['f3f604f8-12f7-4929-bba9-91d0a13e42d0', '03618b1d-1dbf-443c-889a-c6672fa4ef12', '3deb29a0-a236-4466-90d1-49d2854948e7', '14d6f147-df18-4b03-95b0-edfe39b58c92'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:13:54 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-2f78ccd6-f0fb-41dc-b90a-f1e8499ef9f8 tempest-SnapshotsActionsTest-1307534859 None] Delete snapshot completed successfully. Jul 21 02:13:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2f78ccd6-f0fb-41dc-b90a-f1e8499ef9f8 tempest-SnapshotsActionsTest-1307534859 None] Lock "cinder-09cef5ed-8abf-4356-b700-87704f84df11-delete_snapshot" released by "delete_snapshot" :: held 3.267s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:13:56 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ef1d01cf-8507-4217-88a6-d43c7e9032f0 tempest-VolumesActionsTest-1474695972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f /opt/stack/data/cinder/conversion/683285b7-a02c-4fcd-bc2c-abbfcb02905f.temp_image.c47b2f7c-6c77-443d-bd61-2c8f05a8c4722_88cqo3.img" returned: 0 in 4.469s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:56 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd388d4-1685-461e-8c7f-dff3c3ce09d7]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:13:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ef1d01cf-8507-4217-88a6-d43c7e9032f0 tempest-VolumesActionsTest-1474695972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:13:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6925fa5b-419e-4e3f-ac25-4e043591d734 tempest-SnapshotsActionsTest-483682043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:13:56 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f Jul 21 02:13:56 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:13:56 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Jul 21 02:13:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ef1d01cf-8507-4217-88a6-d43c7e9032f0 tempest-VolumesActionsTest-1474695972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f" returned: 0 in 0.524s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:13:56 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-ef1d01cf-8507-4217-88a6-d43c7e9032f0 tempest-VolumesActionsTest-1474695972 None] Image conversion details: src /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f, size 1024.00 MB, duration 4.47 sec, destination /opt/stack/data/cinder/conversion/683285b7-a02c-4fcd-bc2c-abbfcb02905f.temp_image.c47b2f7c-6c77-443d-bd61-2c8f05a8c4722_88cqo3.img {{(pid=87566) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 02:13:56 devstack cinder-volume[87566]: INFO cinder.image.image_utils [None req-ef1d01cf-8507-4217-88a6-d43c7e9032f0 tempest-VolumesActionsTest-1474695972 None] Converted 1024.00 MB image at 229.10 MB/s Jul 21 02:13:56 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-ef1d01cf-8507-4217-88a6-d43c7e9032f0 tempest-VolumesActionsTest-1474695972 None] c47b2f7c-6c77-443d-bd61-2c8f05a8c472 was raw, no need to convert to raw {{(pid=87566) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 21 02:14:06 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:UPDATE=85,cinder:SELECT=73,cinder:INSERT=27,cinder:DELETE=4 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:14:06 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=89,cinder:UPDATE=89,cinder:INSERT=28,cinder:DELETE=10 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:14:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ef1d01cf-8507-4217-88a6-d43c7e9032f0 tempest-VolumesActionsTest-1474695972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.130s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:14:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ef1d01cf-8507-4217-88a6-d43c7e9032f0 tempest-VolumesActionsTest-1474695972 None] Uploaded volume to glance image-id: c47b2f7c-6c77-443d-bd61-2c8f05a8c472. {{(pid=87566) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 21 02:14:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.188s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:14:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-820449715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22fd9ac0-03bc-4957-9053-fea527344d16,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7b6aa09893c64b05a9b477d5ba84f890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:13:51Z,use_quota=True,user_id='3afcfaf4e50c40139be1d679103db1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:14:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] Creating volume 22fd9ac0-03bc-4957-9053-fea527344d16 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:14:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:14:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:14:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:14:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:14:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:14:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:14:15 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:14:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-22fd9ac0-03bc-4957-9053-fea527344d16 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:15 devstack sudo[97653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-22fd9ac0-03bc-4957-9053-fea527344d16 1073741824 Jul 21 02:14:15 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:16 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-ef1d01cf-8507-4217-88a6-d43c7e9032f0 tempest-VolumesActionsTest-1474695972 None] Copy volume to image completed successfully. Jul 21 02:14:16 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-22fd9ac0-03bc-4957-9053-fea527344d16 1073741824" returned: 0 in 0.455s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-22fd9ac0-03bc-4957-9053-fea527344d16 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:16 devstack sudo[97658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-22fd9ac0-03bc-4957-9053-fea527344d16 Jul 21 02:14:16 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:16 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-22fd9ac0-03bc-4957-9053-fea527344d16" returned: 0 in 0.238s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:16 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:14:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:14:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.411s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:14:16 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:13:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-314305963',display_name='tempest-VolumesGetTest-Volume-1502820081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af8270b0-acc5-4f83-b49d-02ad0ee4f635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59682f03e56f442a95b488e6ada71d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:13:52Z,use_quota=True,user_id='4b359d60f98340a3a412c9a72404c995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:14:16 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] Creating volume af8270b0-acc5-4f83-b49d-02ad0ee4f635 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:14:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:14:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:14:16 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:14:16 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:14:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:14:16 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:14:16 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:14:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-af8270b0-acc5-4f83-b49d-02ad0ee4f635 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:16 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-af8270b0-acc5-4f83-b49d-02ad0ee4f635 1073741824 Jul 21 02:14:16 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:16 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1088b960-1434-4cb3-9e0d-128e6e314626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22fd9ac0-03bc-4957-9053-fea527344d16', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:16 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9a1dca0-fc2d-4b45-b27b-156d6d8b42a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:16 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] Volume volume-22fd9ac0-03bc-4957-9053-fea527344d16 (22fd9ac0-03bc-4957-9053-fea527344d16): created successfully Jul 21 02:14:16 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9a1dca0-fc2d-4b45-b27b-156d6d8b42a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:16 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] Flow 'volume_create_manager' (9daa8212-09ee-467b-b1ed-48c7259fa620) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:14:16 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-b78a730c-9dc0-4b84-a573-35535ebf791b tempest-VolumesTestJSON-1245641136 None] Created volume successfully. Jul 21 02:14:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cb22f00a-3f5d-4c22-af35-bfe16178dba4 tempest-VolumesActionsTest-1474695972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:14:17 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-af8270b0-acc5-4f83-b49d-02ad0ee4f635 1073741824" returned: 0 in 0.426s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-af8270b0-acc5-4f83-b49d-02ad0ee4f635 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:17 devstack sudo[97666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-af8270b0-acc5-4f83-b49d-02ad0ee4f635 Jul 21 02:14:17 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:17 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-af8270b0-acc5-4f83-b49d-02ad0ee4f635" returned: 0 in 0.240s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:17 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:14:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:14:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6925fa5b-419e-4e3f-ac25-4e043591d734 tempest-SnapshotsActionsTest-483682043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 21.187s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:14:17 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-6925fa5b-419e-4e3f-ac25-4e043591d734 tempest-SnapshotsActionsTest-483682043 None] Creating offline snapshot f19693b5-6ea9-4def-96fa-3cfcd2e3bdbd of volume 3c36e84f-425b-4d30-90f1-38bb7b2582a1 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:14:17 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313d0164-a714-40b0-ab0c-4c3a073e217e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af8270b0-acc5-4f83-b49d-02ad0ee4f635', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:17 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caaee7b7-b4cf-4101-824e-99c2808b0126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:17 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[36798856-1004-4a2b-b3f7-ea7c45395cf5]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:14:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6925fa5b-419e-4e3f-ac25-4e043591d734 tempest-SnapshotsActionsTest-483682043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:17 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] Volume volume-af8270b0-acc5-4f83-b49d-02ad0ee4f635 (af8270b0-acc5-4f83-b49d-02ad0ee4f635): created successfully Jul 21 02:14:17 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caaee7b7-b4cf-4101-824e-99c2808b0126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:17 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] Flow 'volume_create_manager' (8c508b1e-b0f8-442f-9a02-fcb5299bca1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:14:17 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-3695a9f1-4101-4a91-bd3f-8949c534a697 tempest-VolumesGetTest-1773935590 None] Created volume successfully. Jul 21 02:14:17 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 Jul 21 02:14:17 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-fbbb7eb7-4aa3-4621-af79-7ceb7dd538bc tempest-VolumesGetTest-1773935590 None] Acquiring lock "cinder-af8270b0-acc5-4f83-b49d-02ad0ee4f635-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:14:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-fbbb7eb7-4aa3-4621-af79-7ceb7dd538bc tempest-VolumesGetTest-1773935590 None] Lock "cinder-af8270b0-acc5-4f83-b49d-02ad0ee4f635-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:14:17 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6925fa5b-419e-4e3f-ac25-4e043591d734 tempest-SnapshotsActionsTest-483682043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205" returned: 0 in 0.431s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:17 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-6925fa5b-419e-4e3f-ac25-4e043591d734 tempest-SnapshotsActionsTest-483682043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:14:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6925fa5b-419e-4e3f-ac25-4e043591d734 tempest-SnapshotsActionsTest-483682043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.f19693b5-6ea9-4def-96fa-3cfcd2e3bdbd 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-fbbb7eb7-4aa3-4621-af79-7ceb7dd538bc tempest-VolumesGetTest-1773935590 None] Acquiring lock "cinder-quobyte-af8270b0-acc5-4f83-b49d-02ad0ee4f635" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:14:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-fbbb7eb7-4aa3-4621-af79-7ceb7dd538bc tempest-VolumesGetTest-1773935590 None] Lock "cinder-quobyte-af8270b0-acc5-4f83-b49d-02ad0ee4f635" acquired by "delete_volume" :: waited 0.019s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:14:17 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.f19693b5-6ea9-4def-96fa-3cfcd2e3bdbd 1G Jul 21 02:14:17 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56705c5-0b2c-427f-834a-c59860be59c5]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fbbb7eb7-4aa3-4621-af79-7ceb7dd538bc tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-af8270b0-acc5-4f83-b49d-02ad0ee4f635 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] Flow 'volume_create_manager' (27819789-04c9-4a6a-96b8-88d441978c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90242a7a-2a87-4cd8-b6be-251d0492a24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90242a7a-2a87-4cd8-b6be-251d0492a24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1504029860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=063b49dd-4046-41bd-9067-53e28686681f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7b6aa09893c64b05a9b477d5ba84f890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:14:18Z,use_quota=True,user_id='3afcfaf4e50c40139be1d679103db1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d0bba1-1a76-4320-9418-2765f1e6f3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d0bba1-1a76-4320-9418-2765f1e6f3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ed74a0b-0acd-46cf-811c-9349a0701cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ed74a0b-0acd-46cf-811c-9349a0701cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '063b49dd-4046-41bd-9067-53e28686681f', 'volume_name': 'volume-063b49dd-4046-41bd-9067-53e28686681f', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c914695-463a-4030-9b38-b1e4cc6cb774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c914695-463a-4030-9b38-b1e4cc6cb774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2891aa4-7f85-4238-bdbb-4a00ee56e73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:18 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] Volume 063b49dd-4046-41bd-9067-53e28686681f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-063b49dd-4046-41bd-9067-53e28686681f', 'volume_size': 1} Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:14:18 devstack sudo[97676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-af8270b0-acc5-4f83-b49d-02ad0ee4f635 Jul 21 02:14:18 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:18 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6925fa5b-419e-4e3f-ac25-4e043591d734 tempest-SnapshotsActionsTest-483682043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.f19693b5-6ea9-4def-96fa-3cfcd2e3bdbd 1G" returned: 0 in 0.476s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:18 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6925fa5b-419e-4e3f-ac25-4e043591d734 tempest-SnapshotsActionsTest-483682043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.f19693b5-6ea9-4def-96fa-3cfcd2e3bdbd {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fbbb7eb7-4aa3-4621-af79-7ceb7dd538bc tempest-VolumesGetTest-1773935590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-af8270b0-acc5-4f83-b49d-02ad0ee4f635" returned: 0 in 0.378s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fbbb7eb7-4aa3-4621-af79-7ceb7dd538bc tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-af8270b0-acc5-4f83-b49d-02ad0ee4f635 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:18 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.f19693b5-6ea9-4def-96fa-3cfcd2e3bdbd Jul 21 02:14:18 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:18 devstack sudo[97685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-af8270b0-acc5-4f83-b49d-02ad0ee4f635 Jul 21 02:14:18 devstack sudo[97685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:18 devstack sudo[97685]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fbbb7eb7-4aa3-4621-af79-7ceb7dd538bc tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-af8270b0-acc5-4f83-b49d-02ad0ee4f635" returned: 0 in 0.242s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-fbbb7eb7-4aa3-4621-af79-7ceb7dd538bc tempest-VolumesGetTest-1773935590 None] Lock "cinder-quobyte-af8270b0-acc5-4f83-b49d-02ad0ee4f635" released by "delete_volume" :: held 0.685s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:14:18 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6925fa5b-419e-4e3f-ac25-4e043591d734 tempest-SnapshotsActionsTest-483682043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.f19693b5-6ea9-4def-96fa-3cfcd2e3bdbd" returned: 0 in 0.288s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:18 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-6925fa5b-419e-4e3f-ac25-4e043591d734 tempest-SnapshotsActionsTest-483682043 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.f19693b5-6ea9-4def-96fa-3cfcd2e3bdbd is being set with open permissions: ugo+rw Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6925fa5b-419e-4e3f-ac25-4e043591d734 tempest-SnapshotsActionsTest-483682043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.f19693b5-6ea9-4def-96fa-3cfcd2e3bdbd {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:18 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.f19693b5-6ea9-4def-96fa-3cfcd2e3bdbd Jul 21 02:14:18 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-fbbb7eb7-4aa3-4621-af79-7ceb7dd538bc tempest-VolumesGetTest-1773935590 None] Created reservations ['16a7a043-bc63-4faf-b16b-35b6c1c6d8eb', 'f4c54d40-5ee8-499c-86d0-83f37883de5e', 'f7e7606a-ae70-4f9b-897c-8b3668e1d5e7', '9e3472a7-2c04-4014-b4c3-41b3a6cd131d'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-fbbb7eb7-4aa3-4621-af79-7ceb7dd538bc tempest-VolumesGetTest-1773935590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-fbbb7eb7-4aa3-4621-af79-7ceb7dd538bc tempest-VolumesGetTest-1773935590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-fbbb7eb7-4aa3-4621-af79-7ceb7dd538bc tempest-VolumesGetTest-1773935590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-fbbb7eb7-4aa3-4621-af79-7ceb7dd538bc tempest-VolumesGetTest-1773935590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-fbbb7eb7-4aa3-4621-af79-7ceb7dd538bc tempest-VolumesGetTest-1773935590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fbbb7eb7-4aa3-4621-af79-7ceb7dd538bc tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:18 devstack sudo[97694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:14:18 devstack sudo[97694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:18 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6925fa5b-419e-4e3f-ac25-4e043591d734 tempest-SnapshotsActionsTest-483682043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.f19693b5-6ea9-4def-96fa-3cfcd2e3bdbd" returned: 0 in 0.250s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6925fa5b-419e-4e3f-ac25-4e043591d734 tempest-SnapshotsActionsTest-483682043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.555s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cb22f00a-3f5d-4c22-af35-bfe16178dba4 tempest-VolumesActionsTest-1474695972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.015s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d52544c-7751-458a-be01-0c5c7e4cb93c]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:14:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb22f00a-3f5d-4c22-af35-bfe16178dba4 tempest-VolumesActionsTest-1474695972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:19 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-6925fa5b-419e-4e3f-ac25-4e043591d734 tempest-SnapshotsActionsTest-483682043 None] Create snapshot completed successfully Jul 21 02:14:19 devstack sudo[97694]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fbbb7eb7-4aa3-4621-af79-7ceb7dd538bc tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.276s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:19 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-fbbb7eb7-4aa3-4621-af79-7ceb7dd538bc tempest-VolumesGetTest-1773935590 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:14:19 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-fbbb7eb7-4aa3-4621-af79-7ceb7dd538bc tempest-VolumesGetTest-1773935590 None] Deleted volume successfully. Jul 21 02:14:19 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-fbbb7eb7-4aa3-4621-af79-7ceb7dd538bc tempest-VolumesGetTest-1773935590 None] Lock "cinder-af8270b0-acc5-4f83-b49d-02ad0ee4f635-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:14:19 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-7dae8ca4-0c87-4199-a2d9-1d56cf171565 tempest-VolumesGetTest-1773935590 None] Acquiring lock "cinder-c303c953-d208-424b-a091-7441a72fd2ba-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:14:19 devstack sudo[97697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f Jul 21 02:14:19 devstack sudo[97697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:19 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-7dae8ca4-0c87-4199-a2d9-1d56cf171565 tempest-VolumesGetTest-1773935590 None] Lock "cinder-c303c953-d208-424b-a091-7441a72fd2ba-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:14:19 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-7dae8ca4-0c87-4199-a2d9-1d56cf171565 tempest-VolumesGetTest-1773935590 None] Acquiring lock "cinder-quobyte-c303c953-d208-424b-a091-7441a72fd2ba" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:14:19 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-7dae8ca4-0c87-4199-a2d9-1d56cf171565 tempest-VolumesGetTest-1773935590 None] Lock "cinder-quobyte-c303c953-d208-424b-a091-7441a72fd2ba" acquired by "delete_volume" :: waited 0.017s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:14:19 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[644db86b-4e18-4a1e-a937-b67b92a14276]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:14:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7dae8ca4-0c87-4199-a2d9-1d56cf171565 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c303c953-d208-424b-a091-7441a72fd2ba {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:19 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c303c953-d208-424b-a091-7441a72fd2ba Jul 21 02:14:19 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:19 devstack sudo[97697]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb22f00a-3f5d-4c22-af35-bfe16178dba4 tempest-VolumesActionsTest-1474695972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f" returned: 0 in 0.397s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:19 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d4ea7a-0b54-4eef-aef7-da0bdbf6d878]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:14:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb22f00a-3f5d-4c22-af35-bfe16178dba4 tempest-VolumesActionsTest-1474695972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:19 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f Jul 21 02:14:19 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:19 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7dae8ca4-0c87-4199-a2d9-1d56cf171565 tempest-VolumesGetTest-1773935590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c303c953-d208-424b-a091-7441a72fd2ba" returned: 0 in 0.354s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7dae8ca4-0c87-4199-a2d9-1d56cf171565 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c303c953-d208-424b-a091-7441a72fd2ba {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:19 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c303c953-d208-424b-a091-7441a72fd2ba Jul 21 02:14:19 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:19 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb22f00a-3f5d-4c22-af35-bfe16178dba4 tempest-VolumesActionsTest-1474695972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f" returned: 0 in 0.361s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb22f00a-3f5d-4c22-af35-bfe16178dba4 tempest-VolumesActionsTest-1474695972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f /opt/stack/data/cinder/conversion/683285b7-a02c-4fcd-bc2c-abbfcb02905f.temp_image.a45fa025-4f7c-41c9-affb-2960cdb7f00eag5phykd.img {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:19 devstack sudo[97715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f /opt/stack/data/cinder/conversion/683285b7-a02c-4fcd-bc2c-abbfcb02905f.temp_image.a45fa025-4f7c-41c9-affb-2960cdb7f00eag5phykd.img Jul 21 02:14:19 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:19 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7dae8ca4-0c87-4199-a2d9-1d56cf171565 tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c303c953-d208-424b-a091-7441a72fd2ba" returned: 0 in 0.250s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:19 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-7dae8ca4-0c87-4199-a2d9-1d56cf171565 tempest-VolumesGetTest-1773935590 None] Lock "cinder-quobyte-c303c953-d208-424b-a091-7441a72fd2ba" released by "delete_volume" :: held 0.646s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:14:19 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-7dae8ca4-0c87-4199-a2d9-1d56cf171565 tempest-VolumesGetTest-1773935590 None] Created reservations ['d37e72c8-0aef-4fc0-ab7e-ca769bd08ae6', 'fd3bbc53-3071-482b-a346-44ce7590da1c', '44ced1b9-2a1f-4667-82ca-aff4c3ac3f51', '0d370745-f652-4161-8064-e3a25c530ad0'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:14:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7dae8ca4-0c87-4199-a2d9-1d56cf171565 tempest-VolumesGetTest-1773935590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:14:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7dae8ca4-0c87-4199-a2d9-1d56cf171565 tempest-VolumesGetTest-1773935590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:14:19 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7dae8ca4-0c87-4199-a2d9-1d56cf171565 tempest-VolumesGetTest-1773935590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:14:19 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7dae8ca4-0c87-4199-a2d9-1d56cf171565 tempest-VolumesGetTest-1773935590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:14:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7dae8ca4-0c87-4199-a2d9-1d56cf171565 tempest-VolumesGetTest-1773935590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:14:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7dae8ca4-0c87-4199-a2d9-1d56cf171565 tempest-VolumesGetTest-1773935590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:20 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:14:20 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b03e265e-e20a-48cd-a9ac-ea5e6d1cb3dc tempest-SnapshotsActionsTest-1307534859 None] Acquiring lock "cinder-f19693b5-6ea9-4def-96fa-3cfcd2e3bdbd-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:14:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b03e265e-e20a-48cd-a9ac-ea5e6d1cb3dc tempest-SnapshotsActionsTest-1307534859 None] Lock "cinder-f19693b5-6ea9-4def-96fa-3cfcd2e3bdbd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.065s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:14:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b03e265e-e20a-48cd-a9ac-ea5e6d1cb3dc tempest-SnapshotsActionsTest-1307534859 None] Acquiring lock "cinder-quobyte-3c36e84f-425b-4d30-90f1-38bb7b2582a1" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:14:20 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7dae8ca4-0c87-4199-a2d9-1d56cf171565 tempest-VolumesGetTest-1773935590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.561s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:20 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-7dae8ca4-0c87-4199-a2d9-1d56cf171565 tempest-VolumesGetTest-1773935590 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:14:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b03e265e-e20a-48cd-a9ac-ea5e6d1cb3dc tempest-SnapshotsActionsTest-1307534859 None] Lock "cinder-quobyte-3c36e84f-425b-4d30-90f1-38bb7b2582a1" acquired by "delete_snapshot" :: waited 0.095s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:14:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b03e265e-e20a-48cd-a9ac-ea5e6d1cb3dc tempest-SnapshotsActionsTest-1307534859 None] Acquiring lock "cinder-quobyte-f19693b5-6ea9-4def-96fa-3cfcd2e3bdbd" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:14:20 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-7dae8ca4-0c87-4199-a2d9-1d56cf171565 tempest-VolumesGetTest-1773935590 None] Deleted volume successfully. Jul 21 02:14:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b03e265e-e20a-48cd-a9ac-ea5e6d1cb3dc tempest-SnapshotsActionsTest-1307534859 None] Lock "cinder-quobyte-f19693b5-6ea9-4def-96fa-3cfcd2e3bdbd" acquired by "_delete_snapshot" :: waited 0.069s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:14:20 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-b03e265e-e20a-48cd-a9ac-ea5e6d1cb3dc tempest-SnapshotsActionsTest-1307534859 None] Deleting offline snapshot f19693b5-6ea9-4def-96fa-3cfcd2e3bdbd of volume 3c36e84f-425b-4d30-90f1-38bb7b2582a1 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:14:20 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-b03e265e-e20a-48cd-a9ac-ea5e6d1cb3dc tempest-SnapshotsActionsTest-1307534859 None] snapshot_file for this snap is: volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.f19693b5-6ea9-4def-96fa-3cfcd2e3bdbd {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:14:20 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25c3172-e821-4902-b454-b10e1c13f1fc]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:14:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b03e265e-e20a-48cd-a9ac-ea5e6d1cb3dc tempest-SnapshotsActionsTest-1307534859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.f19693b5-6ea9-4def-96fa-3cfcd2e3bdbd {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-7dae8ca4-0c87-4199-a2d9-1d56cf171565 tempest-VolumesGetTest-1773935590 None] Lock "cinder-c303c953-d208-424b-a091-7441a72fd2ba-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:14:21 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.f19693b5-6ea9-4def-96fa-3cfcd2e3bdbd Jul 21 02:14:21 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:21 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b03e265e-e20a-48cd-a9ac-ea5e6d1cb3dc tempest-SnapshotsActionsTest-1307534859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.f19693b5-6ea9-4def-96fa-3cfcd2e3bdbd" returned: 0 in 1.099s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:21 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-b03e265e-e20a-48cd-a9ac-ea5e6d1cb3dc tempest-SnapshotsActionsTest-1307534859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:14:21 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bceb56c-8d6f-49e2-8aef-c176f2d0fe57]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:14:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b03e265e-e20a-48cd-a9ac-ea5e6d1cb3dc tempest-SnapshotsActionsTest-1307534859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:22 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 Jul 21 02:14:22 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:22 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b03e265e-e20a-48cd-a9ac-ea5e6d1cb3dc tempest-SnapshotsActionsTest-1307534859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205" returned: 0 in 0.796s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:22 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-b03e265e-e20a-48cd-a9ac-ea5e6d1cb3dc tempest-SnapshotsActionsTest-1307534859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:14:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b03e265e-e20a-48cd-a9ac-ea5e6d1cb3dc tempest-SnapshotsActionsTest-1307534859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.f19693b5-6ea9-4def-96fa-3cfcd2e3bdbd {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:22 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.f19693b5-6ea9-4def-96fa-3cfcd2e3bdbd Jul 21 02:14:22 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:23 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b03e265e-e20a-48cd-a9ac-ea5e6d1cb3dc tempest-SnapshotsActionsTest-1307534859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.f19693b5-6ea9-4def-96fa-3cfcd2e3bdbd" returned: 0 in 1.166s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b03e265e-e20a-48cd-a9ac-ea5e6d1cb3dc tempest-SnapshotsActionsTest-1307534859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.f19693b5-6ea9-4def-96fa-3cfcd2e3bdbd {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:23 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.f19693b5-6ea9-4def-96fa-3cfcd2e3bdbd Jul 21 02:14:23 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:24 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b03e265e-e20a-48cd-a9ac-ea5e6d1cb3dc tempest-SnapshotsActionsTest-1307534859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.f19693b5-6ea9-4def-96fa-3cfcd2e3bdbd" returned: 0 in 0.888s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:24 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b03e265e-e20a-48cd-a9ac-ea5e6d1cb3dc tempest-SnapshotsActionsTest-1307534859 None] Lock "cinder-quobyte-f19693b5-6ea9-4def-96fa-3cfcd2e3bdbd" released by "_delete_snapshot" :: held 4.211s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:14:24 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b03e265e-e20a-48cd-a9ac-ea5e6d1cb3dc tempest-SnapshotsActionsTest-1307534859 None] Lock "cinder-quobyte-3c36e84f-425b-4d30-90f1-38bb7b2582a1" released by "delete_snapshot" :: held 4.296s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:14:24 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb22f00a-3f5d-4c22-af35-bfe16178dba4 tempest-VolumesActionsTest-1474695972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f /opt/stack/data/cinder/conversion/683285b7-a02c-4fcd-bc2c-abbfcb02905f.temp_image.a45fa025-4f7c-41c9-affb-2960cdb7f00eag5phykd.img" returned: 0 in 5.119s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:24 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae1af2e-e639-4e07-8a05-de996245ea6a]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:14:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb22f00a-3f5d-4c22-af35-bfe16178dba4 tempest-VolumesActionsTest-1474695972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:24 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-b03e265e-e20a-48cd-a9ac-ea5e6d1cb3dc tempest-SnapshotsActionsTest-1307534859 None] Created reservations ['df4442cc-3147-4e19-b964-c23248ccdceb', '0534919b-69cc-404a-82c4-37edd4adc4f1', 'bec48332-5688-4ec4-bd96-c62cd6745708', '9abd96de-8713-42bc-8206-284cd1093ae2'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:14:25 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-b03e265e-e20a-48cd-a9ac-ea5e6d1cb3dc tempest-SnapshotsActionsTest-1307534859 None] Delete snapshot completed successfully. Jul 21 02:14:25 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b03e265e-e20a-48cd-a9ac-ea5e6d1cb3dc tempest-SnapshotsActionsTest-1307534859 None] Lock "cinder-f19693b5-6ea9-4def-96fa-3cfcd2e3bdbd-delete_snapshot" released by "delete_snapshot" :: held 4.556s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:14:25 devstack sudo[97754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f Jul 21 02:14:25 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:25 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb22f00a-3f5d-4c22-af35-bfe16178dba4 tempest-VolumesActionsTest-1474695972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f" returned: 0 in 0.545s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:25 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-cb22f00a-3f5d-4c22-af35-bfe16178dba4 tempest-VolumesActionsTest-1474695972 None] Image conversion details: src /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f, size 1024.00 MB, duration 5.12 sec, destination /opt/stack/data/cinder/conversion/683285b7-a02c-4fcd-bc2c-abbfcb02905f.temp_image.a45fa025-4f7c-41c9-affb-2960cdb7f00eag5phykd.img {{(pid=87566) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 02:14:25 devstack cinder-volume[87566]: INFO cinder.image.image_utils [None req-cb22f00a-3f5d-4c22-af35-bfe16178dba4 tempest-VolumesActionsTest-1474695972 None] Converted 1024.00 MB image at 199.91 MB/s Jul 21 02:14:25 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-cb22f00a-3f5d-4c22-af35-bfe16178dba4 tempest-VolumesActionsTest-1474695972 None] a45fa025-4f7c-41c9-affb-2960cdb7f00e was raw, converting to qcow2 {{(pid=87566) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 21 02:14:25 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[14143116-92d7-451e-842e-f2380180e895]: (4, 'raw') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:14:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb22f00a-3f5d-4c22-af35-bfe16178dba4 tempest-VolumesActionsTest-1474695972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/683285b7-a02c-4fcd-bc2c-abbfcb02905f.temp_image.a45fa025-4f7c-41c9-affb-2960cdb7f00eag5phykd.img {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:25 devstack sudo[97759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/683285b7-a02c-4fcd-bc2c-abbfcb02905f.temp_image.a45fa025-4f7c-41c9-affb-2960cdb7f00eag5phykd.img Jul 21 02:14:25 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:25 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb22f00a-3f5d-4c22-af35-bfe16178dba4 tempest-VolumesActionsTest-1474695972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/683285b7-a02c-4fcd-bc2c-abbfcb02905f.temp_image.a45fa025-4f7c-41c9-affb-2960cdb7f00eag5phykd.img" returned: 0 in 0.341s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb22f00a-3f5d-4c22-af35-bfe16178dba4 tempest-VolumesActionsTest-1474695972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/683285b7-a02c-4fcd-bc2c-abbfcb02905f.temp_image.a45fa025-4f7c-41c9-affb-2960cdb7f00eag5phykd.img {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:25 devstack sudo[97763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/683285b7-a02c-4fcd-bc2c-abbfcb02905f.temp_image.a45fa025-4f7c-41c9-affb-2960cdb7f00eag5phykd.img Jul 21 02:14:25 devstack sudo[97763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:26 devstack sudo[97763]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb22f00a-3f5d-4c22-af35-bfe16178dba4 tempest-VolumesActionsTest-1474695972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/683285b7-a02c-4fcd-bc2c-abbfcb02905f.temp_image.a45fa025-4f7c-41c9-affb-2960cdb7f00eag5phykd.img" returned: 1 in 0.379s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb22f00a-3f5d-4c22-af35-bfe16178dba4 tempest-VolumesActionsTest-1474695972 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/683285b7-a02c-4fcd-bc2c-abbfcb02905f.temp_image.a45fa025-4f7c-41c9-affb-2960cdb7f00eag5phykd.img' failed. Not Retrying. {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 02:14:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb22f00a-3f5d-4c22-af35-bfe16178dba4 tempest-VolumesActionsTest-1474695972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/683285b7-a02c-4fcd-bc2c-abbfcb02905f.temp_image.a45fa025-4f7c-41c9-affb-2960cdb7f00eag5phykd.img /opt/stack/data/cinder/conversion/vol_upload_5bg828hu {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:26 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/683285b7-a02c-4fcd-bc2c-abbfcb02905f.temp_image.a45fa025-4f7c-41c9-affb-2960cdb7f00eag5phykd.img /opt/stack/data/cinder/conversion/vol_upload_5bg828hu Jul 21 02:14:26 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e3532c1a-3b42-4fa3-a199-0b86d7d2e52a tempest-SnapshotsActionsTest-483682043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:14:26 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb22f00a-3f5d-4c22-af35-bfe16178dba4 tempest-VolumesActionsTest-1474695972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/683285b7-a02c-4fcd-bc2c-abbfcb02905f.temp_image.a45fa025-4f7c-41c9-affb-2960cdb7f00eag5phykd.img /opt/stack/data/cinder/conversion/vol_upload_5bg828hu" returned: 0 in 0.273s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:26 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-cb22f00a-3f5d-4c22-af35-bfe16178dba4 tempest-VolumesActionsTest-1474695972 None] Image conversion details: src /opt/stack/data/cinder/conversion/683285b7-a02c-4fcd-bc2c-abbfcb02905f.temp_image.a45fa025-4f7c-41c9-affb-2960cdb7f00eag5phykd.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_5bg828hu {{(pid=87566) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 02:14:26 devstack cinder-volume[87566]: INFO cinder.image.image_utils [None req-cb22f00a-3f5d-4c22-af35-bfe16178dba4 tempest-VolumesActionsTest-1474695972 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 21 02:14:26 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9aaeea5-2621-4c45-a2b6-281ff64b4732]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:14:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb22f00a-3f5d-4c22-af35-bfe16178dba4 tempest-VolumesActionsTest-1474695972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5bg828hu {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:26 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5bg828hu Jul 21 02:14:26 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:26 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb22f00a-3f5d-4c22-af35-bfe16178dba4 tempest-VolumesActionsTest-1474695972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5bg828hu" returned: 0 in 0.342s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cb22f00a-3f5d-4c22-af35-bfe16178dba4 tempest-VolumesActionsTest-1474695972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.320s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:14:28 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cb22f00a-3f5d-4c22-af35-bfe16178dba4 tempest-VolumesActionsTest-1474695972 None] Uploaded volume to glance image-id: a45fa025-4f7c-41c9-affb-2960cdb7f00e. {{(pid=87566) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 21 02:14:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.162s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:14:28 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1504029860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=063b49dd-4046-41bd-9067-53e28686681f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7b6aa09893c64b05a9b477d5ba84f890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:14:18Z,use_quota=True,user_id='3afcfaf4e50c40139be1d679103db1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:14:28 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] Creating volume 063b49dd-4046-41bd-9067-53e28686681f {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:14:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:14:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:14:28 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:14:28 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:14:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:14:28 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:14:28 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:14:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-063b49dd-4046-41bd-9067-53e28686681f 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:28 devstack sudo[97779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-063b49dd-4046-41bd-9067-53e28686681f 1073741824 Jul 21 02:14:28 devstack sudo[97779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:28 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-cb22f00a-3f5d-4c22-af35-bfe16178dba4 tempest-VolumesActionsTest-1474695972 None] Copy volume to image completed successfully. Jul 21 02:14:28 devstack sudo[97779]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-063b49dd-4046-41bd-9067-53e28686681f 1073741824" returned: 0 in 0.530s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-063b49dd-4046-41bd-9067-53e28686681f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:28 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-063b49dd-4046-41bd-9067-53e28686681f Jul 21 02:14:28 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:29 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-063b49dd-4046-41bd-9067-53e28686681f" returned: 0 in 0.305s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:29 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:14:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:14:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e3532c1a-3b42-4fa3-a199-0b86d7d2e52a tempest-SnapshotsActionsTest-483682043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.967s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:14:29 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2891aa4-7f85-4238-bdbb-4a00ee56e73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-063b49dd-4046-41bd-9067-53e28686681f', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:29 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a37e304-bcb4-4345-af06-7c9f3ae614e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:29 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-e3532c1a-3b42-4fa3-a199-0b86d7d2e52a tempest-SnapshotsActionsTest-483682043 None] Creating offline snapshot 983be25e-c50b-4f2c-bd93-afbcf99cba0f of volume 3c36e84f-425b-4d30-90f1-38bb7b2582a1 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:14:29 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] Volume volume-063b49dd-4046-41bd-9067-53e28686681f (063b49dd-4046-41bd-9067-53e28686681f): created successfully Jul 21 02:14:29 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a37e304-bcb4-4345-af06-7c9f3ae614e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:29 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] Flow 'volume_create_manager' (27819789-04c9-4a6a-96b8-88d441978c26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:14:29 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5d18a5-9aed-4af0-b5a8-2cd64fe4f6dc]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:14:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e3532c1a-3b42-4fa3-a199-0b86d7d2e52a tempest-SnapshotsActionsTest-483682043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:29 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-923ca7b2-8bd5-496f-8746-76419c85d16c tempest-VolumesActionsTest-1474695972 None] Acquiring lock "cinder-683285b7-a02c-4fcd-bc2c-abbfcb02905f-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:14:29 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-71ad300f-f0e4-48c0-9d3c-0e23a5514c64 tempest-VolumesTestJSON-1245641136 None] Created volume successfully. Jul 21 02:14:29 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-923ca7b2-8bd5-496f-8746-76419c85d16c tempest-VolumesActionsTest-1474695972 None] Lock "cinder-683285b7-a02c-4fcd-bc2c-abbfcb02905f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:14:29 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-923ca7b2-8bd5-496f-8746-76419c85d16c tempest-VolumesActionsTest-1474695972 None] Acquiring lock "cinder-quobyte-683285b7-a02c-4fcd-bc2c-abbfcb02905f" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:14:29 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-923ca7b2-8bd5-496f-8746-76419c85d16c tempest-VolumesActionsTest-1474695972 None] Lock "cinder-quobyte-683285b7-a02c-4fcd-bc2c-abbfcb02905f" acquired by "delete_volume" :: waited 0.016s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:14:29 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e37aff4-3e90-4d86-9c17-f836615e56aa]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:14:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-923ca7b2-8bd5-496f-8746-76419c85d16c tempest-VolumesActionsTest-1474695972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:29 devstack sudo[97790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 Jul 21 02:14:29 devstack sudo[97790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:29 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f Jul 21 02:14:29 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:29 devstack sudo[97790]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e3532c1a-3b42-4fa3-a199-0b86d7d2e52a tempest-SnapshotsActionsTest-483682043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205" returned: 0 in 0.392s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:29 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-e3532c1a-3b42-4fa3-a199-0b86d7d2e52a tempest-SnapshotsActionsTest-483682043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:14:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e3532c1a-3b42-4fa3-a199-0b86d7d2e52a tempest-SnapshotsActionsTest-483682043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.983be25e-c50b-4f2c-bd93-afbcf99cba0f 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:29 devstack sudo[97797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.983be25e-c50b-4f2c-bd93-afbcf99cba0f 1G Jul 21 02:14:29 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:29 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-923ca7b2-8bd5-496f-8746-76419c85d16c tempest-VolumesActionsTest-1474695972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f" returned: 0 in 0.384s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-923ca7b2-8bd5-496f-8746-76419c85d16c tempest-VolumesActionsTest-1474695972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:29 devstack sudo[97802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f Jul 21 02:14:29 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:30 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-923ca7b2-8bd5-496f-8746-76419c85d16c tempest-VolumesActionsTest-1474695972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-683285b7-a02c-4fcd-bc2c-abbfcb02905f" returned: 0 in 0.284s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-923ca7b2-8bd5-496f-8746-76419c85d16c tempest-VolumesActionsTest-1474695972 None] Lock "cinder-quobyte-683285b7-a02c-4fcd-bc2c-abbfcb02905f" released by "delete_volume" :: held 0.718s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:14:30 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-923ca7b2-8bd5-496f-8746-76419c85d16c tempest-VolumesActionsTest-1474695972 None] Created reservations ['6375c373-e743-4e15-8d1e-4afcbb4ac084', '4163da61-f53b-4bd4-804f-a145c635fe62', '998bcb06-002d-4bc0-85a1-148f77448868', '8461c577-f5a8-41a6-9264-c5eac4aa7406'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:14:30 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e3532c1a-3b42-4fa3-a199-0b86d7d2e52a tempest-SnapshotsActionsTest-483682043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.983be25e-c50b-4f2c-bd93-afbcf99cba0f 1G" returned: 0 in 0.555s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e3532c1a-3b42-4fa3-a199-0b86d7d2e52a tempest-SnapshotsActionsTest-483682043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.983be25e-c50b-4f2c-bd93-afbcf99cba0f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:30 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.983be25e-c50b-4f2c-bd93-afbcf99cba0f Jul 21 02:14:30 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-923ca7b2-8bd5-496f-8746-76419c85d16c tempest-VolumesActionsTest-1474695972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:14:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-923ca7b2-8bd5-496f-8746-76419c85d16c tempest-VolumesActionsTest-1474695972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:14:30 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-923ca7b2-8bd5-496f-8746-76419c85d16c tempest-VolumesActionsTest-1474695972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:14:30 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-923ca7b2-8bd5-496f-8746-76419c85d16c tempest-VolumesActionsTest-1474695972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:14:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-923ca7b2-8bd5-496f-8746-76419c85d16c tempest-VolumesActionsTest-1474695972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:14:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-923ca7b2-8bd5-496f-8746-76419c85d16c tempest-VolumesActionsTest-1474695972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:30 devstack sudo[97810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:14:30 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:30 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e3532c1a-3b42-4fa3-a199-0b86d7d2e52a tempest-SnapshotsActionsTest-483682043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.983be25e-c50b-4f2c-bd93-afbcf99cba0f" returned: 0 in 0.389s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:30 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-e3532c1a-3b42-4fa3-a199-0b86d7d2e52a tempest-SnapshotsActionsTest-483682043 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.983be25e-c50b-4f2c-bd93-afbcf99cba0f is being set with open permissions: ugo+rw Jul 21 02:14:30 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e3532c1a-3b42-4fa3-a199-0b86d7d2e52a tempest-SnapshotsActionsTest-483682043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.983be25e-c50b-4f2c-bd93-afbcf99cba0f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-923ca7b2-8bd5-496f-8746-76419c85d16c tempest-VolumesActionsTest-1474695972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.330s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:30 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-923ca7b2-8bd5-496f-8746-76419c85d16c tempest-VolumesActionsTest-1474695972 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:14:30 devstack sudo[97816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.983be25e-c50b-4f2c-bd93-afbcf99cba0f Jul 21 02:14:30 devstack sudo[97816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:30 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-923ca7b2-8bd5-496f-8746-76419c85d16c tempest-VolumesActionsTest-1474695972 None] Deleted volume successfully. Jul 21 02:14:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-923ca7b2-8bd5-496f-8746-76419c85d16c tempest-VolumesActionsTest-1474695972 None] Lock "cinder-683285b7-a02c-4fcd-bc2c-abbfcb02905f-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:14:31 devstack sudo[97816]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e3532c1a-3b42-4fa3-a199-0b86d7d2e52a tempest-SnapshotsActionsTest-483682043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.983be25e-c50b-4f2c-bd93-afbcf99cba0f" returned: 0 in 0.373s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e3532c1a-3b42-4fa3-a199-0b86d7d2e52a tempest-SnapshotsActionsTest-483682043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.892s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:14:31 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-e3532c1a-3b42-4fa3-a199-0b86d7d2e52a tempest-SnapshotsActionsTest-483682043 None] Create snapshot completed successfully Jul 21 02:14:31 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-484763cd-3a52-44e2-9f49-c65359a1a780 tempest-VolumesTestJSON-1245641136 None] Acquiring lock "cinder-063b49dd-4046-41bd-9067-53e28686681f-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:14:31 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-484763cd-3a52-44e2-9f49-c65359a1a780 tempest-VolumesTestJSON-1245641136 None] Lock "cinder-063b49dd-4046-41bd-9067-53e28686681f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:14:31 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-484763cd-3a52-44e2-9f49-c65359a1a780 tempest-VolumesTestJSON-1245641136 None] Acquiring lock "cinder-quobyte-063b49dd-4046-41bd-9067-53e28686681f" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:14:31 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-484763cd-3a52-44e2-9f49-c65359a1a780 tempest-VolumesTestJSON-1245641136 None] Lock "cinder-quobyte-063b49dd-4046-41bd-9067-53e28686681f" acquired by "delete_volume" :: waited 0.024s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:14:31 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4ea3ec09-76ac-4a8c-825d-9db5077e672c tempest-SnapshotsActionsTest-1307534859 None] Acquiring lock "cinder-983be25e-c50b-4f2c-bd93-afbcf99cba0f-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:14:31 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[167f6c9a-a27d-47cb-adef-6a1866a04586]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:14:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-484763cd-3a52-44e2-9f49-c65359a1a780 tempest-VolumesTestJSON-1245641136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-063b49dd-4046-41bd-9067-53e28686681f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:31 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4ea3ec09-76ac-4a8c-825d-9db5077e672c tempest-SnapshotsActionsTest-1307534859 None] Lock "cinder-983be25e-c50b-4f2c-bd93-afbcf99cba0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:14:31 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4ea3ec09-76ac-4a8c-825d-9db5077e672c tempest-SnapshotsActionsTest-1307534859 None] Acquiring lock "cinder-quobyte-3c36e84f-425b-4d30-90f1-38bb7b2582a1" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:14:31 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4ea3ec09-76ac-4a8c-825d-9db5077e672c tempest-SnapshotsActionsTest-1307534859 None] Lock "cinder-quobyte-3c36e84f-425b-4d30-90f1-38bb7b2582a1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:14:31 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4ea3ec09-76ac-4a8c-825d-9db5077e672c tempest-SnapshotsActionsTest-1307534859 None] Acquiring lock "cinder-quobyte-983be25e-c50b-4f2c-bd93-afbcf99cba0f" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:14:31 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4ea3ec09-76ac-4a8c-825d-9db5077e672c tempest-SnapshotsActionsTest-1307534859 None] Lock "cinder-quobyte-983be25e-c50b-4f2c-bd93-afbcf99cba0f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:14:31 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-4ea3ec09-76ac-4a8c-825d-9db5077e672c tempest-SnapshotsActionsTest-1307534859 None] Deleting offline snapshot 983be25e-c50b-4f2c-bd93-afbcf99cba0f of volume 3c36e84f-425b-4d30-90f1-38bb7b2582a1 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:14:31 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-4ea3ec09-76ac-4a8c-825d-9db5077e672c tempest-SnapshotsActionsTest-1307534859 None] snapshot_file for this snap is: volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.983be25e-c50b-4f2c-bd93-afbcf99cba0f {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:14:31 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0a7487-d282-47a3-904f-4cbb28513be7]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:14:31 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-063b49dd-4046-41bd-9067-53e28686681f Jul 21 02:14:31 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4ea3ec09-76ac-4a8c-825d-9db5077e672c tempest-SnapshotsActionsTest-1307534859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.983be25e-c50b-4f2c-bd93-afbcf99cba0f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:31 devstack sudo[97821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.983be25e-c50b-4f2c-bd93-afbcf99cba0f Jul 21 02:14:31 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:32 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-484763cd-3a52-44e2-9f49-c65359a1a780 tempest-VolumesTestJSON-1245641136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-063b49dd-4046-41bd-9067-53e28686681f" returned: 0 in 0.427s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-484763cd-3a52-44e2-9f49-c65359a1a780 tempest-VolumesTestJSON-1245641136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-063b49dd-4046-41bd-9067-53e28686681f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:32 devstack sudo[97827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-063b49dd-4046-41bd-9067-53e28686681f Jul 21 02:14:32 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:32 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4ea3ec09-76ac-4a8c-825d-9db5077e672c tempest-SnapshotsActionsTest-1307534859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.983be25e-c50b-4f2c-bd93-afbcf99cba0f" returned: 0 in 0.448s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:32 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-4ea3ec09-76ac-4a8c-825d-9db5077e672c tempest-SnapshotsActionsTest-1307534859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:14:32 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8ac441-4c8c-4c03-88cf-58650a6a6382]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:14:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4ea3ec09-76ac-4a8c-825d-9db5077e672c tempest-SnapshotsActionsTest-1307534859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:32 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-484763cd-3a52-44e2-9f49-c65359a1a780 tempest-VolumesTestJSON-1245641136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-063b49dd-4046-41bd-9067-53e28686681f" returned: 0 in 0.309s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:32 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-484763cd-3a52-44e2-9f49-c65359a1a780 tempest-VolumesTestJSON-1245641136 None] Lock "cinder-quobyte-063b49dd-4046-41bd-9067-53e28686681f" released by "delete_volume" :: held 0.801s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:14:32 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 Jul 21 02:14:32 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:32 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-484763cd-3a52-44e2-9f49-c65359a1a780 tempest-VolumesTestJSON-1245641136 None] Created reservations ['65f027f7-5964-4e16-a164-2aaae83373a4', '6c67bbee-5964-4793-96c4-801dac2eeeb1', 'f0c7eaac-913e-4319-a7d2-c1fe078d7a36', '6bfe929b-e426-4c72-8439-d276ac93c5a7'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:14:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-484763cd-3a52-44e2-9f49-c65359a1a780 tempest-VolumesTestJSON-1245641136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:14:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-484763cd-3a52-44e2-9f49-c65359a1a780 tempest-VolumesTestJSON-1245641136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:14:32 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-484763cd-3a52-44e2-9f49-c65359a1a780 tempest-VolumesTestJSON-1245641136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:14:32 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-484763cd-3a52-44e2-9f49-c65359a1a780 tempest-VolumesTestJSON-1245641136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:14:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-484763cd-3a52-44e2-9f49-c65359a1a780 tempest-VolumesTestJSON-1245641136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:14:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-484763cd-3a52-44e2-9f49-c65359a1a780 tempest-VolumesTestJSON-1245641136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:32 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:14:32 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:32 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e1f91b19-6646-4d58-8c35-d98e27e7cae6 tempest-VolumesTestJSON-1245641136 None] Acquiring lock "cinder-22fd9ac0-03bc-4957-9053-fea527344d16-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:14:32 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e1f91b19-6646-4d58-8c35-d98e27e7cae6 tempest-VolumesTestJSON-1245641136 None] Lock "cinder-22fd9ac0-03bc-4957-9053-fea527344d16-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:14:32 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4ea3ec09-76ac-4a8c-825d-9db5077e672c tempest-SnapshotsActionsTest-1307534859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205" returned: 0 in 0.532s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:32 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-4ea3ec09-76ac-4a8c-825d-9db5077e672c tempest-SnapshotsActionsTest-1307534859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:14:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4ea3ec09-76ac-4a8c-825d-9db5077e672c tempest-SnapshotsActionsTest-1307534859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.983be25e-c50b-4f2c-bd93-afbcf99cba0f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:32 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e1f91b19-6646-4d58-8c35-d98e27e7cae6 tempest-VolumesTestJSON-1245641136 None] Acquiring lock "cinder-quobyte-22fd9ac0-03bc-4957-9053-fea527344d16" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:14:32 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.983be25e-c50b-4f2c-bd93-afbcf99cba0f Jul 21 02:14:32 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:32 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-484763cd-3a52-44e2-9f49-c65359a1a780 tempest-VolumesTestJSON-1245641136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.360s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:32 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-484763cd-3a52-44e2-9f49-c65359a1a780 tempest-VolumesTestJSON-1245641136 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:14:32 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e1f91b19-6646-4d58-8c35-d98e27e7cae6 tempest-VolumesTestJSON-1245641136 None] Lock "cinder-quobyte-22fd9ac0-03bc-4957-9053-fea527344d16" acquired by "delete_volume" :: waited 0.045s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:14:33 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-484763cd-3a52-44e2-9f49-c65359a1a780 tempest-VolumesTestJSON-1245641136 None] Deleted volume successfully. Jul 21 02:14:33 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[982cebfe-3502-43d0-9767-6bcdbff0e83c]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:14:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e1f91b19-6646-4d58-8c35-d98e27e7cae6 tempest-VolumesTestJSON-1245641136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-22fd9ac0-03bc-4957-9053-fea527344d16 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:33 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-484763cd-3a52-44e2-9f49-c65359a1a780 tempest-VolumesTestJSON-1245641136 None] Lock "cinder-063b49dd-4046-41bd-9067-53e28686681f-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:14:33 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-22fd9ac0-03bc-4957-9053-fea527344d16 Jul 21 02:14:33 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:33 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e1f91b19-6646-4d58-8c35-d98e27e7cae6 tempest-VolumesTestJSON-1245641136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-22fd9ac0-03bc-4957-9053-fea527344d16" returned: 0 in 0.433s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e1f91b19-6646-4d58-8c35-d98e27e7cae6 tempest-VolumesTestJSON-1245641136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-22fd9ac0-03bc-4957-9053-fea527344d16 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:33 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-22fd9ac0-03bc-4957-9053-fea527344d16 Jul 21 02:14:33 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:33 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4ea3ec09-76ac-4a8c-825d-9db5077e672c tempest-SnapshotsActionsTest-1307534859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.983be25e-c50b-4f2c-bd93-afbcf99cba0f" returned: 0 in 0.720s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4ea3ec09-76ac-4a8c-825d-9db5077e672c tempest-SnapshotsActionsTest-1307534859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.983be25e-c50b-4f2c-bd93-afbcf99cba0f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:33 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.983be25e-c50b-4f2c-bd93-afbcf99cba0f Jul 21 02:14:33 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:33 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e1f91b19-6646-4d58-8c35-d98e27e7cae6 tempest-VolumesTestJSON-1245641136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-22fd9ac0-03bc-4957-9053-fea527344d16" returned: 0 in 0.321s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:33 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e1f91b19-6646-4d58-8c35-d98e27e7cae6 tempest-VolumesTestJSON-1245641136 None] Lock "cinder-quobyte-22fd9ac0-03bc-4957-9053-fea527344d16" released by "delete_volume" :: held 0.885s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:14:33 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4ea3ec09-76ac-4a8c-825d-9db5077e672c tempest-SnapshotsActionsTest-1307534859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.983be25e-c50b-4f2c-bd93-afbcf99cba0f" returned: 0 in 0.384s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:33 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4ea3ec09-76ac-4a8c-825d-9db5077e672c tempest-SnapshotsActionsTest-1307534859 None] Lock "cinder-quobyte-983be25e-c50b-4f2c-bd93-afbcf99cba0f" released by "_delete_snapshot" :: held 2.254s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:14:33 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-e1f91b19-6646-4d58-8c35-d98e27e7cae6 tempest-VolumesTestJSON-1245641136 None] Created reservations ['d8c398d9-4b91-4033-b9bb-72e5c9be7059', '0f3f630e-d281-4d45-b891-6e63dff82160', '4314d74a-ea74-400a-b4b1-b09855f8ad29', '98d4edf6-ad03-4222-a9d2-af3bd2010672'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:14:33 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4ea3ec09-76ac-4a8c-825d-9db5077e672c tempest-SnapshotsActionsTest-1307534859 None] Lock "cinder-quobyte-3c36e84f-425b-4d30-90f1-38bb7b2582a1" released by "delete_snapshot" :: held 2.289s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:14:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e1f91b19-6646-4d58-8c35-d98e27e7cae6 tempest-VolumesTestJSON-1245641136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:14:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e1f91b19-6646-4d58-8c35-d98e27e7cae6 tempest-VolumesTestJSON-1245641136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:14:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e1f91b19-6646-4d58-8c35-d98e27e7cae6 tempest-VolumesTestJSON-1245641136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:14:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e1f91b19-6646-4d58-8c35-d98e27e7cae6 tempest-VolumesTestJSON-1245641136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:14:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e1f91b19-6646-4d58-8c35-d98e27e7cae6 tempest-VolumesTestJSON-1245641136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:14:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e1f91b19-6646-4d58-8c35-d98e27e7cae6 tempest-VolumesTestJSON-1245641136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:34 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-4ea3ec09-76ac-4a8c-825d-9db5077e672c tempest-SnapshotsActionsTest-1307534859 None] Created reservations ['e091d298-b6d3-419e-80e9-80825b49505a', 'b520364f-5992-47ef-9beb-a030dd2fae8c', '5c9792cd-cd54-42d4-ab4c-a96a115179a1', 'a87f7672-126f-420f-83d0-ff8abc952066'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:14:34 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:14:34 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:34 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-4ea3ec09-76ac-4a8c-825d-9db5077e672c tempest-SnapshotsActionsTest-1307534859 None] Delete snapshot completed successfully. Jul 21 02:14:34 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4ea3ec09-76ac-4a8c-825d-9db5077e672c tempest-SnapshotsActionsTest-1307534859 None] Lock "cinder-983be25e-c50b-4f2c-bd93-afbcf99cba0f-delete_snapshot" released by "delete_snapshot" :: held 2.562s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:14:34 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e1f91b19-6646-4d58-8c35-d98e27e7cae6 tempest-VolumesTestJSON-1245641136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.336s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:34 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-e1f91b19-6646-4d58-8c35-d98e27e7cae6 tempest-VolumesTestJSON-1245641136 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:14:34 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-e1f91b19-6646-4d58-8c35-d98e27e7cae6 tempest-VolumesTestJSON-1245641136 None] Deleted volume successfully. Jul 21 02:14:34 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e1f91b19-6646-4d58-8c35-d98e27e7cae6 tempest-VolumesTestJSON-1245641136 None] Lock "cinder-22fd9ac0-03bc-4957-9053-fea527344d16-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:14:35 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-7f3acc43-3568-482f-9144-a0a03f3d1895 tempest-VolumesTestJSON-1245641136 None] Acquiring lock "cinder-77e405af-e0b2-4cf4-a0e8-8dbffa6b351d-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:14:35 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-7f3acc43-3568-482f-9144-a0a03f3d1895 tempest-VolumesTestJSON-1245641136 None] Lock "cinder-77e405af-e0b2-4cf4-a0e8-8dbffa6b351d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:14:35 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-7f3acc43-3568-482f-9144-a0a03f3d1895 tempest-VolumesTestJSON-1245641136 None] Acquiring lock "cinder-quobyte-77e405af-e0b2-4cf4-a0e8-8dbffa6b351d" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:14:35 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-7f3acc43-3568-482f-9144-a0a03f3d1895 tempest-VolumesTestJSON-1245641136 None] Lock "cinder-quobyte-77e405af-e0b2-4cf4-a0e8-8dbffa6b351d" acquired by "delete_volume" :: waited 0.024s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:14:35 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb63956-7ceb-4ea0-8912-7f137517c994]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:14:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7f3acc43-3568-482f-9144-a0a03f3d1895 tempest-VolumesTestJSON-1245641136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-77e405af-e0b2-4cf4-a0e8-8dbffa6b351d {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:35 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1fb9c819-e598-4449-9a60-907e62764fcb tempest-SnapshotsActionsTest-483682043 None] Acquiring lock "cinder-af3a7e49-b0a4-4f43-8664-64784deb5205-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:14:35 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1fb9c819-e598-4449-9a60-907e62764fcb tempest-SnapshotsActionsTest-483682043 None] Lock "cinder-af3a7e49-b0a4-4f43-8664-64784deb5205-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:14:35 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1fb9c819-e598-4449-9a60-907e62764fcb tempest-SnapshotsActionsTest-483682043 None] Acquiring lock "cinder-quobyte-3c36e84f-425b-4d30-90f1-38bb7b2582a1" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:14:35 devstack sudo[97863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-77e405af-e0b2-4cf4-a0e8-8dbffa6b351d Jul 21 02:14:35 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:35 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1fb9c819-e598-4449-9a60-907e62764fcb tempest-SnapshotsActionsTest-483682043 None] Lock "cinder-quobyte-3c36e84f-425b-4d30-90f1-38bb7b2582a1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:14:35 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1fb9c819-e598-4449-9a60-907e62764fcb tempest-SnapshotsActionsTest-483682043 None] Acquiring lock "cinder-quobyte-af3a7e49-b0a4-4f43-8664-64784deb5205" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:14:35 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1fb9c819-e598-4449-9a60-907e62764fcb tempest-SnapshotsActionsTest-483682043 None] Lock "cinder-quobyte-af3a7e49-b0a4-4f43-8664-64784deb5205" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:14:35 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-1fb9c819-e598-4449-9a60-907e62764fcb tempest-SnapshotsActionsTest-483682043 None] Deleting offline snapshot af3a7e49-b0a4-4f43-8664-64784deb5205 of volume 3c36e84f-425b-4d30-90f1-38bb7b2582a1 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:14:35 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-1fb9c819-e598-4449-9a60-907e62764fcb tempest-SnapshotsActionsTest-483682043 None] snapshot_file for this snap is: volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:14:35 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[592ea610-d7b5-41b8-93f1-491cde3302ba]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:14:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1fb9c819-e598-4449-9a60-907e62764fcb tempest-SnapshotsActionsTest-483682043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:35 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 Jul 21 02:14:35 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:35 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7f3acc43-3568-482f-9144-a0a03f3d1895 tempest-VolumesTestJSON-1245641136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-77e405af-e0b2-4cf4-a0e8-8dbffa6b351d" returned: 0 in 0.670s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7f3acc43-3568-482f-9144-a0a03f3d1895 tempest-VolumesTestJSON-1245641136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-77e405af-e0b2-4cf4-a0e8-8dbffa6b351d {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:35 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-77e405af-e0b2-4cf4-a0e8-8dbffa6b351d Jul 21 02:14:35 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:36 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1fb9c819-e598-4449-9a60-907e62764fcb tempest-SnapshotsActionsTest-483682043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205" returned: 0 in 0.493s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:36 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-1fb9c819-e598-4449-9a60-907e62764fcb tempest-SnapshotsActionsTest-483682043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:14:36 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d280e6-04b1-4245-a679-a80bc62deca8]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:14:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1fb9c819-e598-4449-9a60-907e62764fcb tempest-SnapshotsActionsTest-483682043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:36 devstack sudo[97875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1 Jul 21 02:14:36 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:36 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7f3acc43-3568-482f-9144-a0a03f3d1895 tempest-VolumesTestJSON-1245641136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-77e405af-e0b2-4cf4-a0e8-8dbffa6b351d" returned: 0 in 0.341s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:36 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-7f3acc43-3568-482f-9144-a0a03f3d1895 tempest-VolumesTestJSON-1245641136 None] Lock "cinder-quobyte-77e405af-e0b2-4cf4-a0e8-8dbffa6b351d" released by "delete_volume" :: held 1.087s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:14:36 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-7f3acc43-3568-482f-9144-a0a03f3d1895 tempest-VolumesTestJSON-1245641136 None] Created reservations ['25d1effc-526f-4cfc-8597-4679fe633ada', '0238101d-7c81-491e-aa3e-af74221e7a2e', '06054ae1-3336-4a11-a681-ce57f8ce5588', 'e678f7a5-09a7-4c38-8b9c-ac53f829ed77'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:14:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7f3acc43-3568-482f-9144-a0a03f3d1895 tempest-VolumesTestJSON-1245641136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:14:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7f3acc43-3568-482f-9144-a0a03f3d1895 tempest-VolumesTestJSON-1245641136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:14:36 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7f3acc43-3568-482f-9144-a0a03f3d1895 tempest-VolumesTestJSON-1245641136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:14:36 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7f3acc43-3568-482f-9144-a0a03f3d1895 tempest-VolumesTestJSON-1245641136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:14:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7f3acc43-3568-482f-9144-a0a03f3d1895 tempest-VolumesTestJSON-1245641136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:14:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7f3acc43-3568-482f-9144-a0a03f3d1895 tempest-VolumesTestJSON-1245641136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:36 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:14:36 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:36 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1fb9c819-e598-4449-9a60-907e62764fcb tempest-SnapshotsActionsTest-483682043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1" returned: 0 in 0.500s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1fb9c819-e598-4449-9a60-907e62764fcb tempest-SnapshotsActionsTest-483682043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:36 devstack sudo[97883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 Jul 21 02:14:36 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:36 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7f3acc43-3568-482f-9144-a0a03f3d1895 tempest-VolumesTestJSON-1245641136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.321s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:36 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-7f3acc43-3568-482f-9144-a0a03f3d1895 tempest-VolumesTestJSON-1245641136 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:14:36 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-7f3acc43-3568-482f-9144-a0a03f3d1895 tempest-VolumesTestJSON-1245641136 None] Deleted volume successfully. Jul 21 02:14:36 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-7f3acc43-3568-482f-9144-a0a03f3d1895 tempest-VolumesTestJSON-1245641136 None] Lock "cinder-77e405af-e0b2-4cf4-a0e8-8dbffa6b351d-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:14:37 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1fb9c819-e598-4449-9a60-907e62764fcb tempest-SnapshotsActionsTest-483682043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205" returned: 0 in 0.465s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1fb9c819-e598-4449-9a60-907e62764fcb tempest-SnapshotsActionsTest-483682043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:37 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205 Jul 21 02:14:37 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:37 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1fb9c819-e598-4449-9a60-907e62764fcb tempest-SnapshotsActionsTest-483682043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1.af3a7e49-b0a4-4f43-8664-64784deb5205" returned: 0 in 0.366s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:37 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1fb9c819-e598-4449-9a60-907e62764fcb tempest-SnapshotsActionsTest-483682043 None] Lock "cinder-quobyte-af3a7e49-b0a4-4f43-8664-64784deb5205" released by "_delete_snapshot" :: held 1.993s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:14:37 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1fb9c819-e598-4449-9a60-907e62764fcb tempest-SnapshotsActionsTest-483682043 None] Lock "cinder-quobyte-3c36e84f-425b-4d30-90f1-38bb7b2582a1" released by "delete_snapshot" :: held 2.019s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:14:37 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-1fb9c819-e598-4449-9a60-907e62764fcb tempest-SnapshotsActionsTest-483682043 None] Created reservations ['16da8e8c-7afa-432c-906c-136321c7e11b', '46aabef9-86b6-415b-9526-b5e21cf5edf0', 'b374cea8-71c5-42c6-8f3f-c9de32d522a2', '149d43c6-8305-4ac3-98ae-e6b1206661c9'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:14:37 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-1fb9c819-e598-4449-9a60-907e62764fcb tempest-SnapshotsActionsTest-483682043 None] Delete snapshot completed successfully. Jul 21 02:14:37 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1fb9c819-e598-4449-9a60-907e62764fcb tempest-SnapshotsActionsTest-483682043 None] Lock "cinder-af3a7e49-b0a4-4f43-8664-64784deb5205-delete_snapshot" released by "delete_snapshot" :: held 2.268s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:14:38 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-58527b08-8155-4068-8dc3-95f4bffcce30 tempest-SnapshotsActionsTest-483682043 None] Acquiring lock "cinder-3c36e84f-425b-4d30-90f1-38bb7b2582a1-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:14:38 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-58527b08-8155-4068-8dc3-95f4bffcce30 tempest-SnapshotsActionsTest-483682043 None] Lock "cinder-3c36e84f-425b-4d30-90f1-38bb7b2582a1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:14:38 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-58527b08-8155-4068-8dc3-95f4bffcce30 tempest-SnapshotsActionsTest-483682043 None] Acquiring lock "cinder-quobyte-3c36e84f-425b-4d30-90f1-38bb7b2582a1" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:14:38 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-58527b08-8155-4068-8dc3-95f4bffcce30 tempest-SnapshotsActionsTest-483682043 None] Lock "cinder-quobyte-3c36e84f-425b-4d30-90f1-38bb7b2582a1" acquired by "delete_volume" :: waited 0.028s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:14:38 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[442f65c3-a510-40cf-975a-6c970c9ffc74]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:14:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-58527b08-8155-4068-8dc3-95f4bffcce30 tempest-SnapshotsActionsTest-483682043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:39 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1 Jul 21 02:14:39 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:39 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-58527b08-8155-4068-8dc3-95f4bffcce30 tempest-SnapshotsActionsTest-483682043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1" returned: 0 in 0.514s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-58527b08-8155-4068-8dc3-95f4bffcce30 tempest-SnapshotsActionsTest-483682043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:39 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1 Jul 21 02:14:39 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:39 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-58527b08-8155-4068-8dc3-95f4bffcce30 tempest-SnapshotsActionsTest-483682043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3c36e84f-425b-4d30-90f1-38bb7b2582a1" returned: 0 in 0.352s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:39 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-58527b08-8155-4068-8dc3-95f4bffcce30 tempest-SnapshotsActionsTest-483682043 None] Lock "cinder-quobyte-3c36e84f-425b-4d30-90f1-38bb7b2582a1" released by "delete_volume" :: held 0.985s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:14:39 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-58527b08-8155-4068-8dc3-95f4bffcce30 tempest-SnapshotsActionsTest-483682043 None] Created reservations ['4ad09a73-5d3a-4518-99f7-04c4cf9f17ca', '9b847f71-a180-418d-abbf-b45fbd4bbba6', '17331cf9-d44b-48a2-af7b-012e77e3a5c6', 'aa5ca84e-b97c-416c-9f19-83b731b93197'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:14:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-58527b08-8155-4068-8dc3-95f4bffcce30 tempest-SnapshotsActionsTest-483682043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:14:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-58527b08-8155-4068-8dc3-95f4bffcce30 tempest-SnapshotsActionsTest-483682043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:14:40 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-58527b08-8155-4068-8dc3-95f4bffcce30 tempest-SnapshotsActionsTest-483682043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:14:40 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-58527b08-8155-4068-8dc3-95f4bffcce30 tempest-SnapshotsActionsTest-483682043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:14:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-58527b08-8155-4068-8dc3-95f4bffcce30 tempest-SnapshotsActionsTest-483682043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:14:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-58527b08-8155-4068-8dc3-95f4bffcce30 tempest-SnapshotsActionsTest-483682043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:40 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:14:40 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:40 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-58527b08-8155-4068-8dc3-95f4bffcce30 tempest-SnapshotsActionsTest-483682043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.330s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:40 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-58527b08-8155-4068-8dc3-95f4bffcce30 tempest-SnapshotsActionsTest-483682043 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:14:40 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-58527b08-8155-4068-8dc3-95f4bffcce30 tempest-SnapshotsActionsTest-483682043 None] Deleted volume successfully. Jul 21 02:14:40 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-58527b08-8155-4068-8dc3-95f4bffcce30 tempest-SnapshotsActionsTest-483682043 None] Lock "cinder-3c36e84f-425b-4d30-90f1-38bb7b2582a1-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:14:41 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:14:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] Flow 'volume_create_manager' (6a6e3e5a-2f4c-4a07-b9ce-d97d85d10e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:14:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b5433e3-8839-4d07-8c68-70002265f9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b5433e3-8839-4d07-8c68-70002265f9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1991362190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cea321daa91b4ef994886f90f05456db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:14:41Z,use_quota=True,user_id='fbb65510d2d74952847411839390698e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde4c092-8f50-4c6e-95ff-81c5ababd5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde4c092-8f50-4c6e-95ff-81c5ababd5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c41b0c87-9af8-4812-b18e-ec7e192b4fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c41b0c87-9af8-4812-b18e-ec7e192b4fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8', 'volume_name': 'volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (879ae040-bd1a-426d-bd0d-86d108e0735e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (879ae040-bd1a-426d-bd0d-86d108e0735e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60f6e3d7-a39b-4ab0-8a3c-9d50a0c3d79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:41 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] Volume 78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8', 'volume_size': 1} Jul 21 02:14:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:14:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:14:41 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1991362190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cea321daa91b4ef994886f90f05456db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:14:41Z,use_quota=True,user_id='fbb65510d2d74952847411839390698e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:14:41 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] Creating volume 78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:14:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:14:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:14:41 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:14:41 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:14:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:14:41 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:14:41 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:14:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:41 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8 1073741824 Jul 21 02:14:41 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:42 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8 1073741824" returned: 0 in 0.543s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:42 devstack sudo[97911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8 Jul 21 02:14:42 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:42 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8" returned: 0 in 0.403s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:42 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:14:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:14:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60f6e3d7-a39b-4ab0-8a3c-9d50a0c3d79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ada650-677e-4815-978c-55ad8c83d1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:42 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] Volume volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8 (78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8): created successfully Jul 21 02:14:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ada650-677e-4815-978c-55ad8c83d1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] Flow 'volume_create_manager' (6a6e3e5a-2f4c-4a07-b9ce-d97d85d10e35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:14:42 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-d9c59d47-c8af-4cda-bae7-11435555caf2 tempest-VolumesCloneTest-660654953 None] Created volume successfully. Jul 21 02:14:43 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-bc3a4cb8-d01b-4daf-9968-b8961fab1d6d tempest-GroupSnapshotsV319Test-62258764 None] Group tempest-GroupSnapshotsV319Test-Group-1332870908: creating Jul 21 02:14:43 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-bc3a4cb8-d01b-4daf-9968-b8961fab1d6d tempest-GroupSnapshotsV319Test-62258764 None] Group tempest-GroupSnapshotsV319Test-Group-1332870908: created successfully Jul 21 02:14:43 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-bc3a4cb8-d01b-4daf-9968-b8961fab1d6d tempest-GroupSnapshotsV319Test-62258764 None] Create group completed successfully. Jul 21 02:14:44 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:14:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Flow 'volume_create_manager' (f39db87f-37f6-4d40-9c86-188e424f1b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:14:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e38442-e24d-4995-91e6-710afdacf301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e38442-e24d-4995-91e6-710afdacf301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1675489607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4db44af-a943-40dc-a8d2-9022620d52e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cea321daa91b4ef994886f90f05456db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:14:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8,status='creating',terminated_at=None,updated_at=2026-07-21T00:14:44Z,use_quota=True,user_id='fbb65510d2d74952847411839390698e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (321a77bd-027e-4ae4-be99-d8bd198d9245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (321a77bd-027e-4ae4-be99-d8bd198d9245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75cf21f1-2c7e-4794-b512-96d11372d20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75cf21f1-2c7e-4794-b512-96d11372d20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e4db44af-a943-40dc-a8d2-9022620d52e6', 'volume_name': 'volume-e4db44af-a943-40dc-a8d2-9022620d52e6', 'volume_size': 2, 'source_volid': '78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8', 'source_volstatus': 'available'}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e98be052-56a9-45e0-abc7-aeb3078c3d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e98be052-56a9-45e0-abc7-aeb3078c3d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27b08b93-108a-454e-9299-0f29e318c3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:44 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Volume e4db44af-a943-40dc-a8d2-9022620d52e6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e4db44af-a943-40dc-a8d2-9022620d52e6', 'volume_size': 2, 'source_volid': '78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8', 'source_volstatus': 'available'} Jul 21 02:14:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:14:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:14:44 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Cloning volume 78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8 to volume e4db44af-a943-40dc-a8d2-9022620d52e6 Jul 21 02:14:44 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Creating offline snapshot 8e9264bd-69ab-431a-a915-bfe7492497ac of volume 78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:14:44 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bab1aa-edfc-49e1-a5c2-578f5e0d2e45]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:14:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:44 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8 Jul 21 02:14:44 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:45 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:14:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] Flow 'volume_create_manager' (1906a017-ccf9-474b-ab88-62d52bbc7749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:14:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4283f50-2130-4314-8147-300b5de4c94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:45 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8" returned: 0 in 0.740s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8.8e9264bd-69ab-431a-a915-bfe7492497ac 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4283f50-2130-4314-8147-300b5de4c94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1201511127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9541056d-1bd3-4d56-953c-93fb137c00ec,host='devstack@QuobyteHD#QuobyteHD',id=cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec5fe2a31bb48ab98c7592bbcc90283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:14:45Z,use_quota=True,user_id='da389e8fac0f42d2a50041956a33592e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92d82514-4677-4961-b8b5-98f5ddec42f7),volume_type_id=92d82514-4677-4961-b8b5-98f5ddec42f7)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2d5e15-89ae-46aa-8e19-4ebd55fecbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2d5e15-89ae-46aa-8e19-4ebd55fecbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:45 devstack sudo[97920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8.8e9264bd-69ab-431a-a915-bfe7492497ac 1G Jul 21 02:14:45 devstack sudo[97920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2afded6-fbea-4ad4-98ec-c0f5474068a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2afded6-fbea-4ad4-98ec-c0f5474068a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74', 'volume_name': 'volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (055d89dc-ec81-4cb0-aef8-9da5adc5bb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (055d89dc-ec81-4cb0-aef8-9da5adc5bb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d28944-757a-4a31-9337-3d6dee41ca72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:45 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] Volume cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74', 'volume_size': 1} Jul 21 02:14:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:14:45 devstack sudo[97920]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8.8e9264bd-69ab-431a-a915-bfe7492497ac 1G" returned: 0 in 0.571s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8.8e9264bd-69ab-431a-a915-bfe7492497ac {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:45 devstack sudo[97925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8.8e9264bd-69ab-431a-a915-bfe7492497ac Jul 21 02:14:45 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:46 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8.8e9264bd-69ab-431a-a915-bfe7492497ac" returned: 0 in 0.389s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:46 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8.8e9264bd-69ab-431a-a915-bfe7492497ac is being set with open permissions: ugo+rw Jul 21 02:14:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8.8e9264bd-69ab-431a-a915-bfe7492497ac {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:46 devstack sudo[97931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8.8e9264bd-69ab-431a-a915-bfe7492497ac Jul 21 02:14:46 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:46 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8.8e9264bd-69ab-431a-a915-bfe7492497ac" returned: 0 in 0.379s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:46 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8.info Jul 21 02:14:46 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:47 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8.info" returned: 0 in 0.444s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:47 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8.info is being set with open permissions: ugo+rw Jul 21 02:14:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:47 devstack sudo[97937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8.info Jul 21 02:14:47 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:47 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8.info" returned: 0 in 0.297s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Acquiring lock "cinder-quobyte-e4db44af-a943-40dc-a8d2-9022620d52e6" by "_copy_volume_from_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:14:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Lock "cinder-quobyte-e4db44af-a943-40dc-a8d2-9022620d52e6" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:14:47 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] snapshot: 8e9264bd-69ab-431a-a915-bfe7492497ac, volume: e4db44af-a943-40dc-a8d2-9022620d52e6, {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 02:14:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:14:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:14:47 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:14:47 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:14:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:14:47 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe5ce05-ae4a-42dd-8c9a-422de5675284]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:14:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8.8e9264bd-69ab-431a-a915-bfe7492497ac {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:47 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8.8e9264bd-69ab-431a-a915-bfe7492497ac Jul 21 02:14:47 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:48 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8.8e9264bd-69ab-431a-a915-bfe7492497ac" returned: 0 in 0.524s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:14:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8 {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 02:14:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Creating direct copy from snapshot {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 02:14:48 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23cad78-52ee-4e27-ac1f-e75f849ef518]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:14:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:48 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8 Jul 21 02:14:48 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:48 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:14:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Flow 'volume_create_manager' (7b4c6808-76d5-4286-8b6c-aef7c8ea98a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:14:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b058353-86ef-4c64-9e9d-8b10b439ded4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b058353-86ef-4c64-9e9d-8b10b439ded4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1191227400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d182202-0f49-4778-82e6-de5d83e17526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e38e97233c414585dfff7bec8a7116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:14:48Z,use_quota=True,user_id='b8dcb00f911a4bc49e3bff6b31c0e133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04c60166-0a93-489f-b0c3-451d383ee25b),volume_type_id=04c60166-0a93-489f-b0c3-451d383ee25b)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e9088e3-81eb-4811-ad9d-0c2dffb16154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e9088e3-81eb-4811-ad9d-0c2dffb16154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea3decf-efe7-46ad-93b9-6603e4bfa4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea3decf-efe7-46ad-93b9-6603e4bfa4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d182202-0f49-4778-82e6-de5d83e17526', 'volume_name': 'volume-9d182202-0f49-4778-82e6-de5d83e17526', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fedfa62e-fcde-431d-bc36-6bcc8015b78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fedfa62e-fcde-431d-bc36-6bcc8015b78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be722a73-d11a-47c2-a7d2-565be260152e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:48 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Volume 9d182202-0f49-4778-82e6-de5d83e17526: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d182202-0f49-4778-82e6-de5d83e17526', 'volume_size': 1} Jul 21 02:14:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:14:48 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8" returned: 0 in 0.406s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:48 devstack cinder-volume[87566]: DEBUG cinder.utils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Path /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4db44af-a943-40dc-a8d2-9022620d52e6 not found in is_blk_device check {{(pid=87566) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 02:14:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4db44af-a943-40dc-a8d2-9022620d52e6 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:48 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4db44af-a943-40dc-a8d2-9022620d52e6 Jul 21 02:14:48 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:48 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:14:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:14:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:14:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:14:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:14:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:14:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:48 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:14:48 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:49 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.687s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:49 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:14:49 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager._thread_info {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:14:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread count: 28 {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 02:14:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread info: [<_MainThread(MainThread, started 135786703114368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 02:14:54 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4db44af-a943-40dc-a8d2-9022620d52e6" returned: 0 in 5.576s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:54 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6e0220-bdc9-45b8-85e8-83b8dc0755af]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:14:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:54 devstack sudo[98006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8 Jul 21 02:14:54 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:54 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8" returned: 0 in 0.559s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:54 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Image conversion details: src /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8, size 1024.00 MB, duration 5.58 sec, destination /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4db44af-a943-40dc-a8d2-9022620d52e6 {{(pid=87566) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 02:14:54 devstack cinder-volume[87566]: INFO cinder.image.image_utils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Converted 1024.00 MB image at 183.60 MB/s Jul 21 02:14:54 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4db44af-a943-40dc-a8d2-9022620d52e6 is being set with open permissions: ugo+rw Jul 21 02:14:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4db44af-a943-40dc-a8d2-9022620d52e6 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:54 devstack sudo[98012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4db44af-a943-40dc-a8d2-9022620d52e6 Jul 21 02:14:54 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:54 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4db44af-a943-40dc-a8d2-9022620d52e6" returned: 0 in 0.268s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Lock "cinder-quobyte-e4db44af-a943-40dc-a8d2-9022620d52e6" released by "_copy_volume_from_snapshot" :: held 7.458s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:14:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Acquiring lock "cinder-quobyte-8e9264bd-69ab-431a-a915-bfe7492497ac" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:14:54 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:14:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] Flow 'volume_create_manager' (492b4032-005d-42f6-853b-fcce9d3bf0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:14:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8bc5fa4-f694-43a1-a573-0b4208a2d380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Lock "cinder-quobyte-8e9264bd-69ab-431a-a915-bfe7492497ac" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:14:54 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Deleting offline snapshot 8e9264bd-69ab-431a-a915-bfe7492497ac of volume 78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:14:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] snapshot_file for this snap is: volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8.8e9264bd-69ab-431a-a915-bfe7492497ac {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:14:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8bc5fa4-f694-43a1-a573-0b4208a2d380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-340328330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=524d5171-eb4e-4c04-bfff-1f6acf19972b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b46a9ccbd444dbcb99790deb26b6e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:14:55Z,use_quota=True,user_id='1784cfe2817448c8be8ada3439931b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4559c2c-2d42-461d-abf7-9fd1c9db682e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4559c2c-2d42-461d-abf7-9fd1c9db682e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d11467-a5b7-4546-89b5-9cf3553d5b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d11467-a5b7-4546-89b5-9cf3553d5b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '524d5171-eb4e-4c04-bfff-1f6acf19972b', 'volume_name': 'volume-524d5171-eb4e-4c04-bfff-1f6acf19972b', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4daab45a-3bd3-4dab-bf02-f5080f80c83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4daab45a-3bd3-4dab-bf02-f5080f80c83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d8f88fc-188f-4327-984d-f287f00977e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:55 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] Volume 524d5171-eb4e-4c04-bfff-1f6acf19972b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-524d5171-eb4e-4c04-bfff-1f6acf19972b', 'volume_size': 1} Jul 21 02:14:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:14:55 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9ec9a0-fa67-45e3-8be6-69d23aa38779]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:14:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8.8e9264bd-69ab-431a-a915-bfe7492497ac {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:55 devstack sudo[98015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8.8e9264bd-69ab-431a-a915-bfe7492497ac Jul 21 02:14:55 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:55 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8.8e9264bd-69ab-431a-a915-bfe7492497ac" returned: 0 in 0.393s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:14:55 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ca47ff-504d-4453-b7f6-5fe0e0d0f5ac]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:14:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:55 devstack sudo[98020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8 Jul 21 02:14:55 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:55 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8" returned: 0 in 0.384s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8.8e9264bd-69ab-431a-a915-bfe7492497ac {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:55 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8.8e9264bd-69ab-431a-a915-bfe7492497ac Jul 21 02:14:55 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:56 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8.8e9264bd-69ab-431a-a915-bfe7492497ac" returned: 0 in 0.366s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8.8e9264bd-69ab-431a-a915-bfe7492497ac {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:56 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8.8e9264bd-69ab-431a-a915-bfe7492497ac Jul 21 02:14:56 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:56 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8.8e9264bd-69ab-431a-a915-bfe7492497ac" returned: 0 in 0.270s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:56 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Lock "cinder-quobyte-8e9264bd-69ab-431a-a915-bfe7492497ac" released by "_delete_snapshot" :: held 1.560s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:14:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.145s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:14:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.258s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:14:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9541056d-1bd3-4d56-953c-93fb137c00ec,created_at=2026-07-21T00:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1201511127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9541056d-1bd3-4d56-953c-93fb137c00ec,host='devstack@QuobyteHD#QuobyteHD',id=cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec5fe2a31bb48ab98c7592bbcc90283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:14:45Z,use_quota=True,user_id='da389e8fac0f42d2a50041956a33592e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92d82514-4677-4961-b8b5-98f5ddec42f7),volume_type_id=92d82514-4677-4961-b8b5-98f5ddec42f7)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:14:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] Creating volume cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:14:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:14:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:14:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:14:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:14:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:14:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:14:56 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:14:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27b08b93-108a-454e-9299-0f29e318c3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4db44af-a943-40dc-a8d2-9022620d52e6', 'volume_size': 2, 'source_volid': '78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8', 'source_volstatus': 'available'}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:56 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74 1073741824 Jul 21 02:14:56 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (413300a9-4144-4ff6-be38-d91d9c392707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:56 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Volume volume-e4db44af-a943-40dc-a8d2-9022620d52e6 (e4db44af-a943-40dc-a8d2-9022620d52e6): created successfully Jul 21 02:14:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (413300a9-4144-4ff6-be38-d91d9c392707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Flow 'volume_create_manager' (f39db87f-37f6-4d40-9c86-188e424f1b0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:14:56 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-f82313af-9062-4b16-8310-87b500fce185 tempest-VolumesCloneTest-660654953 None] Created volume successfully. Jul 21 02:14:57 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74 1073741824" returned: 0 in 0.571s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:57 devstack sudo[98046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74 Jul 21 02:14:57 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:57 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74" returned: 0 in 0.282s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:57 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:14:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:14:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.180s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:14:57 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1191227400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d182202-0f49-4778-82e6-de5d83e17526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e38e97233c414585dfff7bec8a7116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:14:48Z,use_quota=True,user_id='b8dcb00f911a4bc49e3bff6b31c0e133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04c60166-0a93-489f-b0c3-451d383ee25b),volume_type_id=04c60166-0a93-489f-b0c3-451d383ee25b)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:14:57 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Creating volume 9d182202-0f49-4778-82e6-de5d83e17526 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:14:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:14:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:14:57 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:14:57 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:14:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:14:57 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:14:57 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:14:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9d182202-0f49-4778-82e6-de5d83e17526 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:57 devstack sudo[98059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9d182202-0f49-4778-82e6-de5d83e17526 1073741824 Jul 21 02:14:57 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:57 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d28944-757a-4a31-9337-3d6dee41ca72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:57 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b311fa41-45c3-4cac-b2ea-be4505ad6ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:57 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] Volume volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74 (cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74): created successfully Jul 21 02:14:57 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b311fa41-45c3-4cac-b2ea-be4505ad6ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:57 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] Flow 'volume_create_manager' (1906a017-ccf9-474b-ab88-62d52bbc7749) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:14:57 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-db96c19f-b1ca-49fd-a680-f193418b63ba tempest-GroupSnapshotsV319Test-62258764 None] Created volume successfully. Jul 21 02:14:57 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f382b2cf-f506-4074-aefd-9fc072580c59 tempest-VolumesCloneTest-660654953 None] Acquiring lock "cinder-e4db44af-a943-40dc-a8d2-9022620d52e6-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:14:57 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f382b2cf-f506-4074-aefd-9fc072580c59 tempest-VolumesCloneTest-660654953 None] Lock "cinder-e4db44af-a943-40dc-a8d2-9022620d52e6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:14:57 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f382b2cf-f506-4074-aefd-9fc072580c59 tempest-VolumesCloneTest-660654953 None] Acquiring lock "cinder-quobyte-e4db44af-a943-40dc-a8d2-9022620d52e6" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f382b2cf-f506-4074-aefd-9fc072580c59 tempest-VolumesCloneTest-660654953 None] Lock "cinder-quobyte-e4db44af-a943-40dc-a8d2-9022620d52e6" acquired by "delete_volume" :: waited 0.024s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[114962f9-11ce-463e-b65b-c814ca626609]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f382b2cf-f506-4074-aefd-9fc072580c59 tempest-VolumesCloneTest-660654953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4db44af-a943-40dc-a8d2-9022620d52e6 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:58 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-0cb66cb5-67fe-470e-955a-a7bd30e3eda3 tempest-GroupSnapshotsV319Test-62258764 None] GroupSnapshot 2dfd9c28-3920-4123-bc99-6921bcca39dc: creating. Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0cb66cb5-67fe-470e-955a-a7bd30e3eda3 tempest-GroupSnapshotsV319Test-62258764 None] Group snapshot 2dfd9c28-3920-4123-bc99-6921bcca39dc: creating. {{(pid=87566) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0cb66cb5-67fe-470e-955a-a7bd30e3eda3 tempest-GroupSnapshotsV319Test-62258764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:14:58 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4db44af-a943-40dc-a8d2-9022620d52e6 Jul 21 02:14:58 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:58 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9d182202-0f49-4778-82e6-de5d83e17526 1073741824" returned: 0 in 0.779s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9d182202-0f49-4778-82e6-de5d83e17526 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:58 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9d182202-0f49-4778-82e6-de5d83e17526 Jul 21 02:14:58 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:58 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f382b2cf-f506-4074-aefd-9fc072580c59 tempest-VolumesCloneTest-660654953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4db44af-a943-40dc-a8d2-9022620d52e6" returned: 0 in 0.467s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f382b2cf-f506-4074-aefd-9fc072580c59 tempest-VolumesCloneTest-660654953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4db44af-a943-40dc-a8d2-9022620d52e6 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:58 devstack sudo[98074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4db44af-a943-40dc-a8d2-9022620d52e6 Jul 21 02:14:58 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:58 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9d182202-0f49-4778-82e6-de5d83e17526" returned: 0 in 0.270s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.556s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-340328330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=524d5171-eb4e-4c04-bfff-1f6acf19972b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b46a9ccbd444dbcb99790deb26b6e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:14:55Z,use_quota=True,user_id='1784cfe2817448c8be8ada3439931b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] Creating volume 524d5171-eb4e-4c04-bfff-1f6acf19972b {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:14:58 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:58 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b 1073741824 Jul 21 02:14:58 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be722a73-d11a-47c2-a7d2-565be260152e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d182202-0f49-4778-82e6-de5d83e17526', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08bfd92b-a845-462b-a13a-1e541229e6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:58 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Volume volume-9d182202-0f49-4778-82e6-de5d83e17526 (9d182202-0f49-4778-82e6-de5d83e17526): created successfully Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08bfd92b-a845-462b-a13a-1e541229e6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Flow 'volume_create_manager' (7b4c6808-76d5-4286-8b6c-aef7c8ea98a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:14:58 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-fa421b8f-3542-4170-9db0-1749c6513586 tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Created volume successfully. Jul 21 02:14:58 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f382b2cf-f506-4074-aefd-9fc072580c59 tempest-VolumesCloneTest-660654953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4db44af-a943-40dc-a8d2-9022620d52e6" returned: 0 in 0.284s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f382b2cf-f506-4074-aefd-9fc072580c59 tempest-VolumesCloneTest-660654953 None] Lock "cinder-quobyte-e4db44af-a943-40dc-a8d2-9022620d52e6" released by "delete_volume" :: held 0.821s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-f382b2cf-f506-4074-aefd-9fc072580c59 tempest-VolumesCloneTest-660654953 None] Created reservations ['404901f2-bc57-45c4-9f83-94451eeb6fbe', 'fe199a1f-a405-4007-aae8-ef8e95543b93', '11ce59b1-6aef-45e8-be9f-898f4442c406', '5ac097fb-233e-4173-b509-6dc494c21f21'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f382b2cf-f506-4074-aefd-9fc072580c59 tempest-VolumesCloneTest-660654953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f382b2cf-f506-4074-aefd-9fc072580c59 tempest-VolumesCloneTest-660654953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f382b2cf-f506-4074-aefd-9fc072580c59 tempest-VolumesCloneTest-660654953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f382b2cf-f506-4074-aefd-9fc072580c59 tempest-VolumesCloneTest-660654953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f382b2cf-f506-4074-aefd-9fc072580c59 tempest-VolumesCloneTest-660654953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:14:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f382b2cf-f506-4074-aefd-9fc072580c59 tempest-VolumesCloneTest-660654953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:59 devstack sudo[98083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:14:59 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:59 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-15bcdf49-a60a-40c4-8fd7-35076d6f70ff tempest-VolumesCloneTest-660654953 None] Acquiring lock "cinder-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:14:59 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-15bcdf49-a60a-40c4-8fd7-35076d6f70ff tempest-VolumesCloneTest-660654953 None] Lock "cinder-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:14:59 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b 1073741824" returned: 0 in 0.607s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:59 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f382b2cf-f506-4074-aefd-9fc072580c59 tempest-VolumesCloneTest-660654953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.315s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:59 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-f382b2cf-f506-4074-aefd-9fc072580c59 tempest-VolumesCloneTest-660654953 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:14:59 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-15bcdf49-a60a-40c4-8fd7-35076d6f70ff tempest-VolumesCloneTest-660654953 None] Acquiring lock "cinder-quobyte-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:14:59 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-f382b2cf-f506-4074-aefd-9fc072580c59 tempest-VolumesCloneTest-660654953 None] Deleted volume successfully. Jul 21 02:14:59 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b Jul 21 02:14:59 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:59 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-15bcdf49-a60a-40c4-8fd7-35076d6f70ff tempest-VolumesCloneTest-660654953 None] Lock "cinder-quobyte-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8" acquired by "delete_volume" :: waited 0.049s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:14:59 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f382b2cf-f506-4074-aefd-9fc072580c59 tempest-VolumesCloneTest-660654953 None] Lock "cinder-e4db44af-a943-40dc-a8d2-9022620d52e6-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:14:59 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc091002-ae0d-465c-95b0-edfd1f4233d3]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:14:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-15bcdf49-a60a-40c4-8fd7-35076d6f70ff tempest-VolumesCloneTest-660654953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:59 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8 Jul 21 02:14:59 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:14:59 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b" returned: 0 in 0.412s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:59 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:14:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:14:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0cb66cb5-67fe-470e-955a-a7bd30e3eda3 tempest-GroupSnapshotsV319Test-62258764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.461s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:14:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d8f88fc-188f-4327-984d-f287f00977e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-524d5171-eb4e-4c04-bfff-1f6acf19972b', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f165551-000b-489a-bfdc-57299a3c3036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:14:59 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-0cb66cb5-67fe-470e-955a-a7bd30e3eda3 tempest-GroupSnapshotsV319Test-62258764 None] Creating offline snapshot 473934d5-7713-4589-b047-c837258b590d of volume cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:14:59 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] Volume volume-524d5171-eb4e-4c04-bfff-1f6acf19972b (524d5171-eb4e-4c04-bfff-1f6acf19972b): created successfully Jul 21 02:14:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f165551-000b-489a-bfdc-57299a3c3036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:14:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] Flow 'volume_create_manager' (492b4032-005d-42f6-853b-fcce9d3bf0e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:14:59 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[616e325f-4434-4c4b-b2f3-bd7064500bb5]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:14:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0cb66cb5-67fe-470e-955a-a7bd30e3eda3 tempest-GroupSnapshotsV319Test-62258764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:59 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-8934d41e-30b9-4fdc-b897-077058071e05 tempest-TestStampPattern-361473491 None] Created volume successfully. Jul 21 02:14:59 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Jul 21 02:14:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-15bcdf49-a60a-40c4-8fd7-35076d6f70ff tempest-VolumesCloneTest-660654953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8" returned: 0 in 0.511s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:14:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-15bcdf49-a60a-40c4-8fd7-35076d6f70ff tempest-VolumesCloneTest-660654953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:14:59 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74 Jul 21 02:14:59 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:00 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8 Jul 21 02:15:00 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-98066092-5027-4c08-9deb-428a594e620d tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:15:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-98066092-5027-4c08-9deb-428a594e620d tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:15:00 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-98066092-5027-4c08-9deb-428a594e620d tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:15:00 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-98066092-5027-4c08-9deb-428a594e620d tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:15:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-98066092-5027-4c08-9deb-428a594e620d tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:15:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-98066092-5027-4c08-9deb-428a594e620d tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:00 devstack sudo[98104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:15:00 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:00 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0cb66cb5-67fe-470e-955a-a7bd30e3eda3 tempest-GroupSnapshotsV319Test-62258764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74" returned: 0 in 0.670s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0cb66cb5-67fe-470e-955a-a7bd30e3eda3 tempest-GroupSnapshotsV319Test-62258764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74.473934d5-7713-4589-b047-c837258b590d 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:00 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74.473934d5-7713-4589-b047-c837258b590d 1G Jul 21 02:15:00 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:00 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-15bcdf49-a60a-40c4-8fd7-35076d6f70ff tempest-VolumesCloneTest-660654953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8" returned: 0 in 0.684s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:00 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-15bcdf49-a60a-40c4-8fd7-35076d6f70ff tempest-VolumesCloneTest-660654953 None] Lock "cinder-quobyte-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8" released by "delete_volume" :: held 1.328s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:15:00 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-98066092-5027-4c08-9deb-428a594e620d tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.718s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:00 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-98066092-5027-4c08-9deb-428a594e620d tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:15:00 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-98066092-5027-4c08-9deb-428a594e620d tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Retype volume completed successfully. Jul 21 02:15:00 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-15bcdf49-a60a-40c4-8fd7-35076d6f70ff tempest-VolumesCloneTest-660654953 None] Created reservations ['d72083b2-b959-45e5-bbe1-faebd15dcde0', 'd19e8a31-79be-4794-ada8-c2d6e59fb3c6', '17521e68-e2ce-42fc-b6b7-6dc53438fdf4', '8e224f5f-19ae-4275-b293-be54dcc9e50a'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:15:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-15bcdf49-a60a-40c4-8fd7-35076d6f70ff tempest-VolumesCloneTest-660654953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:15:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-15bcdf49-a60a-40c4-8fd7-35076d6f70ff tempest-VolumesCloneTest-660654953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:15:00 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-15bcdf49-a60a-40c4-8fd7-35076d6f70ff tempest-VolumesCloneTest-660654953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:15:00 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-15bcdf49-a60a-40c4-8fd7-35076d6f70ff tempest-VolumesCloneTest-660654953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:15:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-15bcdf49-a60a-40c4-8fd7-35076d6f70ff tempest-VolumesCloneTest-660654953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:15:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-15bcdf49-a60a-40c4-8fd7-35076d6f70ff tempest-VolumesCloneTest-660654953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:01 devstack sudo[98165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:15:01 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:01 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-15bcdf49-a60a-40c4-8fd7-35076d6f70ff tempest-VolumesCloneTest-660654953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.460s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:01 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-15bcdf49-a60a-40c4-8fd7-35076d6f70ff tempest-VolumesCloneTest-660654953 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:15:01 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-15bcdf49-a60a-40c4-8fd7-35076d6f70ff tempest-VolumesCloneTest-660654953 None] Deleted volume successfully. Jul 21 02:15:01 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0cb66cb5-67fe-470e-955a-a7bd30e3eda3 tempest-GroupSnapshotsV319Test-62258764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74.473934d5-7713-4589-b047-c837258b590d 1G" returned: 0 in 1.036s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0cb66cb5-67fe-470e-955a-a7bd30e3eda3 tempest-GroupSnapshotsV319Test-62258764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74.473934d5-7713-4589-b047-c837258b590d {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-15bcdf49-a60a-40c4-8fd7-35076d6f70ff tempest-VolumesCloneTest-660654953 None] Lock "cinder-78f6a7f1-d2f0-4fd4-bb76-2d3d19558fe8-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:15:01 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74.473934d5-7713-4589-b047-c837258b590d Jul 21 02:15:01 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-7299a63e-600c-4b7d-9813-aa18e17212ee tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Acquiring lock "cinder-9d182202-0f49-4778-82e6-de5d83e17526-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:15:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-7299a63e-600c-4b7d-9813-aa18e17212ee tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Lock "cinder-9d182202-0f49-4778-82e6-de5d83e17526-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:15:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-7299a63e-600c-4b7d-9813-aa18e17212ee tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Acquiring lock "cinder-quobyte-9d182202-0f49-4778-82e6-de5d83e17526" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:15:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-7299a63e-600c-4b7d-9813-aa18e17212ee tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Lock "cinder-quobyte-9d182202-0f49-4778-82e6-de5d83e17526" acquired by "delete_volume" :: waited 0.030s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:15:01 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[13347200-34a8-40ce-ad86-0bf96910fc74]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:15:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7299a63e-600c-4b7d-9813-aa18e17212ee tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9d182202-0f49-4778-82e6-de5d83e17526 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:02 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0cb66cb5-67fe-470e-955a-a7bd30e3eda3 tempest-GroupSnapshotsV319Test-62258764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74.473934d5-7713-4589-b047-c837258b590d" returned: 0 in 0.531s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:02 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-0cb66cb5-67fe-470e-955a-a7bd30e3eda3 tempest-GroupSnapshotsV319Test-62258764 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74.473934d5-7713-4589-b047-c837258b590d is being set with open permissions: ugo+rw: NotImplementedError Jul 21 02:15:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0cb66cb5-67fe-470e-955a-a7bd30e3eda3 tempest-GroupSnapshotsV319Test-62258764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74.473934d5-7713-4589-b047-c837258b590d {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:02 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9d182202-0f49-4778-82e6-de5d83e17526 Jul 21 02:15:02 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:02 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74.473934d5-7713-4589-b047-c837258b590d Jul 21 02:15:02 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:02 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0cb66cb5-67fe-470e-955a-a7bd30e3eda3 tempest-GroupSnapshotsV319Test-62258764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74.473934d5-7713-4589-b047-c837258b590d" returned: 0 in 0.393s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0cb66cb5-67fe-470e-955a-a7bd30e3eda3 tempest-GroupSnapshotsV319Test-62258764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:02 devstack sudo[98202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74.info Jul 21 02:15:02 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:02 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7299a63e-600c-4b7d-9813-aa18e17212ee tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9d182202-0f49-4778-82e6-de5d83e17526" returned: 0 in 0.705s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7299a63e-600c-4b7d-9813-aa18e17212ee tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9d182202-0f49-4778-82e6-de5d83e17526 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:02 devstack sudo[98204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9d182202-0f49-4778-82e6-de5d83e17526 Jul 21 02:15:02 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:02 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0cb66cb5-67fe-470e-955a-a7bd30e3eda3 tempest-GroupSnapshotsV319Test-62258764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74.info" returned: 0 in 0.477s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:02 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-0cb66cb5-67fe-470e-955a-a7bd30e3eda3 tempest-GroupSnapshotsV319Test-62258764 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 02:15:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0cb66cb5-67fe-470e-955a-a7bd30e3eda3 tempest-GroupSnapshotsV319Test-62258764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:03 devstack sudo[98208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74.info Jul 21 02:15:03 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:03 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7299a63e-600c-4b7d-9813-aa18e17212ee tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9d182202-0f49-4778-82e6-de5d83e17526" returned: 0 in 0.489s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-7299a63e-600c-4b7d-9813-aa18e17212ee tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Lock "cinder-quobyte-9d182202-0f49-4778-82e6-de5d83e17526" released by "delete_volume" :: held 1.276s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:15:03 devstack cinder-volume[87566]: WARNING cinder.quota [None req-7299a63e-600c-4b7d-9813-aa18e17212ee tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 21 02:15:03 devstack cinder-volume[87566]: WARNING cinder.quota [None req-7299a63e-600c-4b7d-9813-aa18e17212ee tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 21 02:15:03 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-7299a63e-600c-4b7d-9813-aa18e17212ee tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Created reservations ['3447ee64-e135-4d17-9551-a088c8a16c8c', '9f70afab-557e-4483-b6f4-87bdc783e2f2', 'e081e5c8-a2d6-450b-a28c-87d8cd5a7147', '2660046a-c2a3-4874-b6d4-d2adb377283a'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:15:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7299a63e-600c-4b7d-9813-aa18e17212ee tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:15:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7299a63e-600c-4b7d-9813-aa18e17212ee tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:15:03 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7299a63e-600c-4b7d-9813-aa18e17212ee tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:15:03 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7299a63e-600c-4b7d-9813-aa18e17212ee tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:15:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7299a63e-600c-4b7d-9813-aa18e17212ee tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:15:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7299a63e-600c-4b7d-9813-aa18e17212ee tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:03 devstack sudo[98210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:15:03 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:03 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0cb66cb5-67fe-470e-955a-a7bd30e3eda3 tempest-GroupSnapshotsV319Test-62258764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74.info" returned: 0 in 0.394s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0cb66cb5-67fe-470e-955a-a7bd30e3eda3 tempest-GroupSnapshotsV319Test-62258764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.686s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:15:03 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-0cb66cb5-67fe-470e-955a-a7bd30e3eda3 tempest-GroupSnapshotsV319Test-62258764 None] group_snapshot 2dfd9c28-3920-4123-bc99-6921bcca39dc: created successfully Jul 21 02:15:03 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7299a63e-600c-4b7d-9813-aa18e17212ee tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.353s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:03 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-7299a63e-600c-4b7d-9813-aa18e17212ee tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:15:03 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-7299a63e-600c-4b7d-9813-aa18e17212ee tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Deleted volume successfully. Jul 21 02:15:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-7299a63e-600c-4b7d-9813-aa18e17212ee tempest-VolumeRetypeWithoutMigrationTest-2053772230 None] Lock "cinder-9d182202-0f49-4778-82e6-de5d83e17526-delete_volume" released by "delete_volume" :: held 2.009s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:15:04 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-d2aea745-e316-4cf0-80bd-2aa145289b7b tempest-GroupSnapshotsV319Test-62258764 None] group_snapshot 2dfd9c28-3920-4123-bc99-6921bcca39dc: deleting Jul 21 02:15:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d2aea745-e316-4cf0-80bd-2aa145289b7b tempest-GroupSnapshotsV319Test-62258764 None] group_snapshot 2dfd9c28-3920-4123-bc99-6921bcca39dc: deleting {{(pid=87566) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 21 02:15:04 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d2aea745-e316-4cf0-80bd-2aa145289b7b tempest-GroupSnapshotsV319Test-62258764 None] Acquiring lock "cinder-quobyte-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:15:04 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d2aea745-e316-4cf0-80bd-2aa145289b7b tempest-GroupSnapshotsV319Test-62258764 None] Lock "cinder-quobyte-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:15:04 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d2aea745-e316-4cf0-80bd-2aa145289b7b tempest-GroupSnapshotsV319Test-62258764 None] Acquiring lock "cinder-quobyte-473934d5-7713-4589-b047-c837258b590d" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:15:04 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d2aea745-e316-4cf0-80bd-2aa145289b7b tempest-GroupSnapshotsV319Test-62258764 None] Lock "cinder-quobyte-473934d5-7713-4589-b047-c837258b590d" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:15:04 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-d2aea745-e316-4cf0-80bd-2aa145289b7b tempest-GroupSnapshotsV319Test-62258764 None] Deleting offline snapshot 473934d5-7713-4589-b047-c837258b590d of volume cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:15:04 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-d2aea745-e316-4cf0-80bd-2aa145289b7b tempest-GroupSnapshotsV319Test-62258764 None] snapshot_file for this snap is: volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74.473934d5-7713-4589-b047-c837258b590d {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:15:04 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0a2cbc-71b5-4ffd-a7f3-0cc853f4eb7b]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:15:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d2aea745-e316-4cf0-80bd-2aa145289b7b tempest-GroupSnapshotsV319Test-62258764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74.473934d5-7713-4589-b047-c837258b590d {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:04 devstack sudo[98220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74.473934d5-7713-4589-b047-c837258b590d Jul 21 02:15:04 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:05 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d2aea745-e316-4cf0-80bd-2aa145289b7b tempest-GroupSnapshotsV319Test-62258764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74.473934d5-7713-4589-b047-c837258b590d" returned: 0 in 0.677s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-d2aea745-e316-4cf0-80bd-2aa145289b7b tempest-GroupSnapshotsV319Test-62258764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:15:05 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a2e518-0651-4ca9-b376-f645822c35d6]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:15:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d2aea745-e316-4cf0-80bd-2aa145289b7b tempest-GroupSnapshotsV319Test-62258764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:05 devstack sudo[98225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74 Jul 21 02:15:05 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:05 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d2aea745-e316-4cf0-80bd-2aa145289b7b tempest-GroupSnapshotsV319Test-62258764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74" returned: 0 in 0.512s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d2aea745-e316-4cf0-80bd-2aa145289b7b tempest-GroupSnapshotsV319Test-62258764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74.473934d5-7713-4589-b047-c837258b590d {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:05 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74.473934d5-7713-4589-b047-c837258b590d Jul 21 02:15:05 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:06 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d2aea745-e316-4cf0-80bd-2aa145289b7b tempest-GroupSnapshotsV319Test-62258764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74.473934d5-7713-4589-b047-c837258b590d" returned: 0 in 0.489s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d2aea745-e316-4cf0-80bd-2aa145289b7b tempest-GroupSnapshotsV319Test-62258764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74.473934d5-7713-4589-b047-c837258b590d {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:06 devstack sudo[98235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74.473934d5-7713-4589-b047-c837258b590d Jul 21 02:15:06 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d2aea745-e316-4cf0-80bd-2aa145289b7b tempest-GroupSnapshotsV319Test-62258764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74.473934d5-7713-4589-b047-c837258b590d" returned: 0 in 0.555s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:06 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:06 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d2aea745-e316-4cf0-80bd-2aa145289b7b tempest-GroupSnapshotsV319Test-62258764 None] Lock "cinder-quobyte-473934d5-7713-4589-b047-c837258b590d" released by "_delete_snapshot" :: held 2.410s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:15:06 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d2aea745-e316-4cf0-80bd-2aa145289b7b tempest-GroupSnapshotsV319Test-62258764 None] Lock "cinder-quobyte-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74" released by "delete_snapshot" :: held 2.450s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:15:06 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:UPDATE=149,cinder:SELECT=103,cinder:INSERT=29,cinder:DELETE=9 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:15:06 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=107,cinder:INSERT=34,cinder:UPDATE=114,cinder:DELETE=11 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:15:07 devstack cinder-volume[87566]: WARNING cinder.quota [None req-d2aea745-e316-4cf0-80bd-2aa145289b7b tempest-GroupSnapshotsV319Test-62258764 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-879819650 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-879819650, it is now deprecated. Please use the default quota class for default quota. Jul 21 02:15:07 devstack cinder-volume[87566]: WARNING cinder.quota [None req-d2aea745-e316-4cf0-80bd-2aa145289b7b tempest-GroupSnapshotsV319Test-62258764 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-879819650 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-879819650, it is now deprecated. Please use the default quota class for default quota. Jul 21 02:15:07 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-d2aea745-e316-4cf0-80bd-2aa145289b7b tempest-GroupSnapshotsV319Test-62258764 None] Created reservations ['391f69a7-f2a3-4417-b7dc-81948c3c17e3', 'cc508b1a-1cfa-475f-b4b7-ba3cb2dbaf46', '0cc4d3f6-b8d9-4f8b-9788-933f1d5517e7', '6eaf07e9-6f46-4c0f-97e3-bbf0216a6b06'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:15:07 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-d2aea745-e316-4cf0-80bd-2aa145289b7b tempest-GroupSnapshotsV319Test-62258764 None] group_snapshot 2dfd9c28-3920-4123-bc99-6921bcca39dc: deleted successfully Jul 21 02:15:08 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-54b6c38d-8d97-41d7-83f6-8d6e5fc983ad tempest-GroupSnapshotsV319Test-62258764 None] Acquiring lock "cinder-quobyte-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:15:08 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-54b6c38d-8d97-41d7-83f6-8d6e5fc983ad tempest-GroupSnapshotsV319Test-62258764 None] Lock "cinder-quobyte-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74" acquired by "delete_volume" :: waited 0.026s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:15:08 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db39467-fd2a-435c-9f28-69fe68f22c94]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:15:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-54b6c38d-8d97-41d7-83f6-8d6e5fc983ad tempest-GroupSnapshotsV319Test-62258764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:08 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74 Jul 21 02:15:08 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:08 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-54b6c38d-8d97-41d7-83f6-8d6e5fc983ad tempest-GroupSnapshotsV319Test-62258764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74" returned: 0 in 0.532s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-54b6c38d-8d97-41d7-83f6-8d6e5fc983ad tempest-GroupSnapshotsV319Test-62258764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:08 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74 Jul 21 02:15:08 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:09 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-54b6c38d-8d97-41d7-83f6-8d6e5fc983ad tempest-GroupSnapshotsV319Test-62258764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74" returned: 0 in 0.416s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:09 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-54b6c38d-8d97-41d7-83f6-8d6e5fc983ad tempest-GroupSnapshotsV319Test-62258764 None] Lock "cinder-quobyte-cef8e066-8c89-4c6c-a0b7-3ba2ad64ee74" released by "delete_volume" :: held 1.055s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:15:09 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-54b6c38d-8d97-41d7-83f6-8d6e5fc983ad tempest-GroupSnapshotsV319Test-62258764 None] Created reservations ['d4d22d85-df8f-4ab9-9be0-e247ffdd4b85'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:15:09 devstack cinder-volume[87566]: WARNING cinder.quota [None req-54b6c38d-8d97-41d7-83f6-8d6e5fc983ad tempest-GroupSnapshotsV319Test-62258764 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-879819650 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-879819650, it is now deprecated. Please use the default quota class for default quota. Jul 21 02:15:09 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-54b6c38d-8d97-41d7-83f6-8d6e5fc983ad tempest-GroupSnapshotsV319Test-62258764 None] Created reservations ['8b33ba23-2960-4176-96ee-aaa28f980ded', 'fc339ac1-3a6e-47a4-9f60-90e106814d82', 'ae5c34ed-aee6-462c-8cf0-0d1fe44b75d6', '36605147-e59e-41b0-b5be-7e8ffe5ae3f7'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:15:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-54b6c38d-8d97-41d7-83f6-8d6e5fc983ad tempest-GroupSnapshotsV319Test-62258764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:15:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-54b6c38d-8d97-41d7-83f6-8d6e5fc983ad tempest-GroupSnapshotsV319Test-62258764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:15:09 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-54b6c38d-8d97-41d7-83f6-8d6e5fc983ad tempest-GroupSnapshotsV319Test-62258764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:15:09 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-54b6c38d-8d97-41d7-83f6-8d6e5fc983ad tempest-GroupSnapshotsV319Test-62258764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:15:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-54b6c38d-8d97-41d7-83f6-8d6e5fc983ad tempest-GroupSnapshotsV319Test-62258764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:15:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-54b6c38d-8d97-41d7-83f6-8d6e5fc983ad tempest-GroupSnapshotsV319Test-62258764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:09 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:15:09 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:10 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-54b6c38d-8d97-41d7-83f6-8d6e5fc983ad tempest-GroupSnapshotsV319Test-62258764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.601s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:10 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-54b6c38d-8d97-41d7-83f6-8d6e5fc983ad tempest-GroupSnapshotsV319Test-62258764 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:15:10 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-54b6c38d-8d97-41d7-83f6-8d6e5fc983ad tempest-GroupSnapshotsV319Test-62258764 None] Delete group completed successfully. Jul 21 02:15:19 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=12,cinder:INSERT=3,cinder:UPDATE=14 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:15:19 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=15,cinder:INSERT=6,cinder:UPDATE=20 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:15:22 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:15:22 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] Flow 'volume_create_manager' (6f0cd69f-1729-4aed-8dec-037aecbffe05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:15:22 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c17c6a3-f8b9-4aea-a5e9-9db2706e91e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:22 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c17c6a3-f8b9-4aea-a5e9-9db2706e91e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1604075452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e79964e-f81e-4773-bcb6-9712ab0ed2b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fafd5f9ce40c480b89a8fd722e218fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:15:23Z,use_quota=True,user_id='5c45bddde11846bb8e7c689ff55f5a27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:22 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d90aca6-d02c-463f-a7c7-f4e733560488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:22 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d90aca6-d02c-463f-a7c7-f4e733560488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:22 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ca8a2d-d93f-42e7-be60-d903e6107409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:22 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ca8a2d-d93f-42e7-be60-d903e6107409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e79964e-f81e-4773-bcb6-9712ab0ed2b0', 'volume_name': 'volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:22 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (815b8114-fa1b-43e2-91e0-08bf5d8fb556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:22 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (815b8114-fa1b-43e2-91e0-08bf5d8fb556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:22 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7b46ec-d85f-4827-946f-cfed347474fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:22 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] Volume 3e79964e-f81e-4773-bcb6-9712ab0ed2b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0', 'volume_size': 1} Jul 21 02:15:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:15:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:15:22 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1604075452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e79964e-f81e-4773-bcb6-9712ab0ed2b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fafd5f9ce40c480b89a8fd722e218fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:15:23Z,use_quota=True,user_id='5c45bddde11846bb8e7c689ff55f5a27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:15:22 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] Creating volume 3e79964e-f81e-4773-bcb6-9712ab0ed2b0 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:15:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:15:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:15:22 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:15:22 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:15:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:15:22 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:15:22 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:15:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:22 devstack sudo[98284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0 1073741824 Jul 21 02:15:22 devstack sudo[98284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:23 devstack sudo[98284]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0 1073741824" returned: 0 in 0.616s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:23 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0 Jul 21 02:15:23 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:23 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0" returned: 0 in 0.360s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:23 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:15:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:15:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7b46ec-d85f-4827-946f-cfed347474fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9a1845e-24d0-4e9e-8670-94d6d1e3c2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:23 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] Volume volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0 (3e79964e-f81e-4773-bcb6-9712ab0ed2b0): created successfully Jul 21 02:15:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9a1845e-24d0-4e9e-8670-94d6d1e3c2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] Flow 'volume_create_manager' (6f0cd69f-1729-4aed-8dec-037aecbffe05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:15:23 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-304e592f-bb02-49eb-b596-a8db4ff8e1a6 tempest-VolumesSnapshotTestJSON-660412331 None] Created volume successfully. Jul 21 02:15:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0f95e03d-6291-4636-b62d-69432b300815 tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:15:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0f95e03d-6291-4636-b62d-69432b300815 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:15:25 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-0f95e03d-6291-4636-b62d-69432b300815 tempest-VolumesSnapshotTestJSON-660412331 None] Creating offline snapshot a776f1ed-aa05-4090-a1c4-d849de6e06e3 of volume 3e79964e-f81e-4773-bcb6-9712ab0ed2b0 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:15:25 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1a74a8-25e4-4462-9613-71e7a780fa76]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:15:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0f95e03d-6291-4636-b62d-69432b300815 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:25 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-fc587a9f-fcaf-43f3-9530-11eab90d4d96 tempest-GroupsV320Test-1616210040 None] Group tempest-GroupsV320Test-Group-1793047507: creating Jul 21 02:15:25 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-fc587a9f-fcaf-43f3-9530-11eab90d4d96 tempest-GroupsV320Test-1616210040 None] Group tempest-GroupsV320Test-Group-1793047507: created successfully Jul 21 02:15:25 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-fc587a9f-fcaf-43f3-9530-11eab90d4d96 tempest-GroupsV320Test-1616210040 None] Create group completed successfully. Jul 21 02:15:25 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0 Jul 21 02:15:25 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:25 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0f95e03d-6291-4636-b62d-69432b300815 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0" returned: 0 in 0.394s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0f95e03d-6291-4636-b62d-69432b300815 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0.a776f1ed-aa05-4090-a1c4-d849de6e06e3 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:25 devstack sudo[98299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0.a776f1ed-aa05-4090-a1c4-d849de6e06e3 1G Jul 21 02:15:25 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:25 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0f95e03d-6291-4636-b62d-69432b300815 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0.a776f1ed-aa05-4090-a1c4-d849de6e06e3 1G" returned: 0 in 0.425s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0f95e03d-6291-4636-b62d-69432b300815 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0.a776f1ed-aa05-4090-a1c4-d849de6e06e3 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:25 devstack sudo[98305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0.a776f1ed-aa05-4090-a1c4-d849de6e06e3 Jul 21 02:15:25 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:26 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0f95e03d-6291-4636-b62d-69432b300815 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0.a776f1ed-aa05-4090-a1c4-d849de6e06e3" returned: 0 in 0.302s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:26 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-0f95e03d-6291-4636-b62d-69432b300815 tempest-VolumesSnapshotTestJSON-660412331 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0.a776f1ed-aa05-4090-a1c4-d849de6e06e3 is being set with open permissions: ugo+rw Jul 21 02:15:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0f95e03d-6291-4636-b62d-69432b300815 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0.a776f1ed-aa05-4090-a1c4-d849de6e06e3 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:26 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0.a776f1ed-aa05-4090-a1c4-d849de6e06e3 Jul 21 02:15:26 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:26 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0f95e03d-6291-4636-b62d-69432b300815 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0.a776f1ed-aa05-4090-a1c4-d849de6e06e3" returned: 0 in 0.268s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0f95e03d-6291-4636-b62d-69432b300815 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:26 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0.info Jul 21 02:15:26 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:26 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-92bfc0ee-f2f2-4adb-bdcf-6cd451c02aab tempest-GroupsV320Test-1616210040 None] Created reservations ['799b02b3-f5bc-47c8-a903-38a51a8f1545'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:15:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-92bfc0ee-f2f2-4adb-bdcf-6cd451c02aab tempest-GroupsV320Test-1616210040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:15:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-92bfc0ee-f2f2-4adb-bdcf-6cd451c02aab tempest-GroupsV320Test-1616210040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:15:26 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-92bfc0ee-f2f2-4adb-bdcf-6cd451c02aab tempest-GroupsV320Test-1616210040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:15:26 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:26 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-92bfc0ee-f2f2-4adb-bdcf-6cd451c02aab tempest-GroupsV320Test-1616210040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:15:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-92bfc0ee-f2f2-4adb-bdcf-6cd451c02aab tempest-GroupsV320Test-1616210040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:15:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-92bfc0ee-f2f2-4adb-bdcf-6cd451c02aab tempest-GroupsV320Test-1616210040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0f95e03d-6291-4636-b62d-69432b300815 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0.info" returned: 0 in 0.322s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:26 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-0f95e03d-6291-4636-b62d-69432b300815 tempest-VolumesSnapshotTestJSON-660412331 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0.info is being set with open permissions: ugo+rw Jul 21 02:15:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0f95e03d-6291-4636-b62d-69432b300815 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:26 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:15:26 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:26 devstack sudo[98318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0.info Jul 21 02:15:26 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:27 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-92bfc0ee-f2f2-4adb-bdcf-6cd451c02aab tempest-GroupsV320Test-1616210040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.277s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:27 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-92bfc0ee-f2f2-4adb-bdcf-6cd451c02aab tempest-GroupsV320Test-1616210040 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:15:27 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-92bfc0ee-f2f2-4adb-bdcf-6cd451c02aab tempest-GroupsV320Test-1616210040 None] Delete group completed successfully. Jul 21 02:15:27 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0f95e03d-6291-4636-b62d-69432b300815 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0.info" returned: 0 in 0.294s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0f95e03d-6291-4636-b62d-69432b300815 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.118s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:15:27 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-0f95e03d-6291-4636-b62d-69432b300815 tempest-VolumesSnapshotTestJSON-660412331 None] Create snapshot completed successfully Jul 21 02:15:28 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b61a0f26-cb81-467e-844d-0a6215f311f5 tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "cinder-a776f1ed-aa05-4090-a1c4-d849de6e06e3-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:15:28 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b61a0f26-cb81-467e-844d-0a6215f311f5 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-a776f1ed-aa05-4090-a1c4-d849de6e06e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:15:28 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b61a0f26-cb81-467e-844d-0a6215f311f5 tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "cinder-quobyte-3e79964e-f81e-4773-bcb6-9712ab0ed2b0" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:15:28 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b61a0f26-cb81-467e-844d-0a6215f311f5 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-quobyte-3e79964e-f81e-4773-bcb6-9712ab0ed2b0" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:15:28 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b61a0f26-cb81-467e-844d-0a6215f311f5 tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "cinder-quobyte-a776f1ed-aa05-4090-a1c4-d849de6e06e3" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:15:28 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b61a0f26-cb81-467e-844d-0a6215f311f5 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-quobyte-a776f1ed-aa05-4090-a1c4-d849de6e06e3" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:15:28 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-b61a0f26-cb81-467e-844d-0a6215f311f5 tempest-VolumesSnapshotTestJSON-660412331 None] Deleting offline snapshot a776f1ed-aa05-4090-a1c4-d849de6e06e3 of volume 3e79964e-f81e-4773-bcb6-9712ab0ed2b0 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:15:28 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-b61a0f26-cb81-467e-844d-0a6215f311f5 tempest-VolumesSnapshotTestJSON-660412331 None] snapshot_file for this snap is: volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0.a776f1ed-aa05-4090-a1c4-d849de6e06e3 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:15:28 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3aad23-2c74-4ddd-b9c8-f0990f27f9ac]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:15:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b61a0f26-cb81-467e-844d-0a6215f311f5 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0.a776f1ed-aa05-4090-a1c4-d849de6e06e3 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:28 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0.a776f1ed-aa05-4090-a1c4-d849de6e06e3 Jul 21 02:15:28 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:28 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b61a0f26-cb81-467e-844d-0a6215f311f5 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0.a776f1ed-aa05-4090-a1c4-d849de6e06e3" returned: 0 in 0.411s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:28 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-b61a0f26-cb81-467e-844d-0a6215f311f5 tempest-VolumesSnapshotTestJSON-660412331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:15:28 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[841ee39e-fe31-4e25-92f7-5c5191c06f6b]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:15:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b61a0f26-cb81-467e-844d-0a6215f311f5 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:29 devstack sudo[98333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0 Jul 21 02:15:29 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:29 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b61a0f26-cb81-467e-844d-0a6215f311f5 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0" returned: 0 in 0.505s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b61a0f26-cb81-467e-844d-0a6215f311f5 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0.a776f1ed-aa05-4090-a1c4-d849de6e06e3 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:29 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0.a776f1ed-aa05-4090-a1c4-d849de6e06e3 Jul 21 02:15:29 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-24752e1b-f132-417d-aa8d-49dfd8beccba req-d594a0b2-8be3-4c2f-ac82-5478d2a3488b tempest-TestStampPattern-361473491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:15:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-24752e1b-f132-417d-aa8d-49dfd8beccba req-d594a0b2-8be3-4c2f-ac82-5478d2a3488b tempest-TestStampPattern-361473491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:15:30 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b61a0f26-cb81-467e-844d-0a6215f311f5 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0.a776f1ed-aa05-4090-a1c4-d849de6e06e3" returned: 0 in 0.566s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b61a0f26-cb81-467e-844d-0a6215f311f5 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0.a776f1ed-aa05-4090-a1c4-d849de6e06e3 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-24752e1b-f132-417d-aa8d-49dfd8beccba req-d594a0b2-8be3-4c2f-ac82-5478d2a3488b tempest-TestStampPattern-361473491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:15:30 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0.a776f1ed-aa05-4090-a1c4-d849de6e06e3 Jul 21 02:15:30 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-24752e1b-f132-417d-aa8d-49dfd8beccba req-d594a0b2-8be3-4c2f-ac82-5478d2a3488b tempest-TestStampPattern-361473491 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea', 'name': 'volume-524d5171-eb4e-4c04-bfff-1f6acf19972b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '964cccc3-e8ff-477a-b2ba-80d6aa3c7d4a', 'enforce_multipath': True} {{(pid=87566) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 02:15:30 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-24752e1b-f132-417d-aa8d-49dfd8beccba req-d594a0b2-8be3-4c2f-ac82-5478d2a3488b tempest-TestStampPattern-361473491 None] attachment_update completed successfully. Jul 21 02:15:30 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b61a0f26-cb81-467e-844d-0a6215f311f5 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0.a776f1ed-aa05-4090-a1c4-d849de6e06e3" returned: 0 in 0.387s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b61a0f26-cb81-467e-844d-0a6215f311f5 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-quobyte-a776f1ed-aa05-4090-a1c4-d849de6e06e3" released by "_delete_snapshot" :: held 2.052s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:15:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b61a0f26-cb81-467e-844d-0a6215f311f5 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-quobyte-3e79964e-f81e-4773-bcb6-9712ab0ed2b0" released by "delete_snapshot" :: held 2.094s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:15:30 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-b61a0f26-cb81-467e-844d-0a6215f311f5 tempest-VolumesSnapshotTestJSON-660412331 None] Created reservations ['30ba6948-9757-4ef6-a5c5-c5c54a71fa21', 'e8167deb-d75b-4778-b39a-025faccbf382', 'd4b04fc1-ab86-4b03-911a-0bf9374fd381', '39677946-3cd4-4a49-bd98-8b79d19ade6a'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:15:30 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-b61a0f26-cb81-467e-844d-0a6215f311f5 tempest-VolumesSnapshotTestJSON-660412331 None] Delete snapshot completed successfully. Jul 21 02:15:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b61a0f26-cb81-467e-844d-0a6215f311f5 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-a776f1ed-aa05-4090-a1c4-d849de6e06e3-delete_snapshot" released by "delete_snapshot" :: held 2.367s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:15:32 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:15:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] Flow 'volume_create_manager' (82f71c1a-9f1e-4fe4-9e53-475c47810a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:15:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fcfd749-bdc7-43c3-b5b7-1fceeb667b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fcfd749-bdc7-43c3-b5b7-1fceeb667b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1579437699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cefabc5-1e44-4b98-8914-7577f2f9a4a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fafd5f9ce40c480b89a8fd722e218fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:15:32Z,use_quota=True,user_id='5c45bddde11846bb8e7c689ff55f5a27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (089f1685-5fb9-4f66-9746-703d532b53de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (089f1685-5fb9-4f66-9746-703d532b53de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (254596e0-64b0-47f6-a1bb-0c63d699ad22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (254596e0-64b0-47f6-a1bb-0c63d699ad22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cefabc5-1e44-4b98-8914-7577f2f9a4a1', 'volume_name': 'volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588e60f3-2e5f-4344-a49d-a98b37ddc630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588e60f3-2e5f-4344-a49d-a98b37ddc630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7065ba06-de20-4014-ae94-10e45d88c774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:32 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] Volume 3cefabc5-1e44-4b98-8914-7577f2f9a4a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1', 'volume_size': 1} Jul 21 02:15:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:15:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:15:32 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1579437699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cefabc5-1e44-4b98-8914-7577f2f9a4a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fafd5f9ce40c480b89a8fd722e218fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:15:32Z,use_quota=True,user_id='5c45bddde11846bb8e7c689ff55f5a27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:15:32 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] Creating volume 3cefabc5-1e44-4b98-8914-7577f2f9a4a1 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:15:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:15:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:15:32 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:15:32 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:15:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:15:32 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:15:32 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:15:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:32 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1 1073741824 Jul 21 02:15:32 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:32 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1 1073741824" returned: 0 in 0.569s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:33 devstack sudo[98759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1 Jul 21 02:15:33 devstack sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:33 devstack sudo[98759]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1" returned: 0 in 0.342s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:33 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:15:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:15:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7065ba06-de20-4014-ae94-10e45d88c774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bdcc87b-d70a-4b45-ae5c-682f2b6b02f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:33 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] Volume volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1 (3cefabc5-1e44-4b98-8914-7577f2f9a4a1): created successfully Jul 21 02:15:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bdcc87b-d70a-4b45-ae5c-682f2b6b02f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] Flow 'volume_create_manager' (82f71c1a-9f1e-4fe4-9e53-475c47810a6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:15:33 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-b54ee589-bf02-4ee9-ac54-689267b8af7a tempest-VolumesSnapshotTestJSON-660412331 None] Created volume successfully. Jul 21 02:15:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3a56bf59-d9f8-4aeb-bfff-f485c54daf5a tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:15:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3a56bf59-d9f8-4aeb-bfff-f485c54daf5a tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:15:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-3a56bf59-d9f8-4aeb-bfff-f485c54daf5a tempest-VolumesSnapshotTestJSON-660412331 None] Creating offline snapshot 0b547a0a-905d-4382-ac81-ca254b0e4d69 of volume 3cefabc5-1e44-4b98-8914-7577f2f9a4a1 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:15:34 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4ac181-0bc3-45cf-8a08-cd9e29a95ae0]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:15:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3a56bf59-d9f8-4aeb-bfff-f485c54daf5a tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:34 devstack sudo[98767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1 Jul 21 02:15:34 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:35 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3a56bf59-d9f8-4aeb-bfff-f485c54daf5a tempest-VolumesSnapshotTestJSON-660412331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1" returned: 0 in 0.513s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3a56bf59-d9f8-4aeb-bfff-f485c54daf5a tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1.0b547a0a-905d-4382-ac81-ca254b0e4d69 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:35 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1.0b547a0a-905d-4382-ac81-ca254b0e4d69 1G Jul 21 02:15:35 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:35 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3a56bf59-d9f8-4aeb-bfff-f485c54daf5a tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1.0b547a0a-905d-4382-ac81-ca254b0e4d69 1G" returned: 0 in 0.584s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3a56bf59-d9f8-4aeb-bfff-f485c54daf5a tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1.0b547a0a-905d-4382-ac81-ca254b0e4d69 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:35 devstack sudo[98785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1.0b547a0a-905d-4382-ac81-ca254b0e4d69 Jul 21 02:15:35 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:36 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-bb4cde24-af07-4e1e-b6ac-2375bc4e3b42 req-1702bb19-70b8-48a0-8236-bc9049528f76 tempest-TestStampPattern-361473491 None] Terminate volume connection completed successfully. Jul 21 02:15:36 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-bb4cde24-af07-4e1e-b6ac-2375bc4e3b42 req-1702bb19-70b8-48a0-8236-bc9049528f76 tempest-TestStampPattern-361473491 None] Deleting attachment 964cccc3-e8ff-477a-b2ba-80d6aa3c7d4a. {{(pid=87566) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 02:15:36 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3a56bf59-d9f8-4aeb-bfff-f485c54daf5a tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1.0b547a0a-905d-4382-ac81-ca254b0e4d69" returned: 0 in 0.445s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:36 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-3a56bf59-d9f8-4aeb-bfff-f485c54daf5a tempest-VolumesSnapshotTestJSON-660412331 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1.0b547a0a-905d-4382-ac81-ca254b0e4d69 is being set with open permissions: ugo+rw Jul 21 02:15:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3a56bf59-d9f8-4aeb-bfff-f485c54daf5a tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1.0b547a0a-905d-4382-ac81-ca254b0e4d69 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:36 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1.0b547a0a-905d-4382-ac81-ca254b0e4d69 Jul 21 02:15:36 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:36 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3a56bf59-d9f8-4aeb-bfff-f485c54daf5a tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1.0b547a0a-905d-4382-ac81-ca254b0e4d69" returned: 0 in 0.312s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3a56bf59-d9f8-4aeb-bfff-f485c54daf5a tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:36 devstack sudo[98820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1.info Jul 21 02:15:36 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:36 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3a56bf59-d9f8-4aeb-bfff-f485c54daf5a tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1.info" returned: 0 in 0.364s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:36 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-3a56bf59-d9f8-4aeb-bfff-f485c54daf5a tempest-VolumesSnapshotTestJSON-660412331 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1.info is being set with open permissions: ugo+rw Jul 21 02:15:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3a56bf59-d9f8-4aeb-bfff-f485c54daf5a tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:36 devstack sudo[98823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1.info Jul 21 02:15:36 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d46e6366-2a5d-4ecf-a0ee-e16534fd808c tempest-TestStampPattern-361473491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:15:37 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3a56bf59-d9f8-4aeb-bfff-f485c54daf5a tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1.info" returned: 0 in 0.278s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3a56bf59-d9f8-4aeb-bfff-f485c54daf5a tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.618s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:15:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d46e6366-2a5d-4ecf-a0ee-e16534fd808c tempest-TestStampPattern-361473491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.258s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:15:37 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-d46e6366-2a5d-4ecf-a0ee-e16534fd808c tempest-TestStampPattern-361473491 None] Creating offline snapshot 6ed3d37a-1c46-45de-bef9-0eeffd11a2e7 of volume 524d5171-eb4e-4c04-bfff-1f6acf19972b {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:15:37 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-3a56bf59-d9f8-4aeb-bfff-f485c54daf5a tempest-VolumesSnapshotTestJSON-660412331 None] Create snapshot completed successfully Jul 21 02:15:37 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbf2e87-0cdc-450c-ae7a-522c97b25396]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:15:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d46e6366-2a5d-4ecf-a0ee-e16534fd808c tempest-TestStampPattern-361473491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:37 devstack sudo[98826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b Jul 21 02:15:37 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:37 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d46e6366-2a5d-4ecf-a0ee-e16534fd808c tempest-TestStampPattern-361473491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b" returned: 0 in 0.408s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d46e6366-2a5d-4ecf-a0ee-e16534fd808c tempest-TestStampPattern-361473491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b.6ed3d37a-1c46-45de-bef9-0eeffd11a2e7 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:37 devstack sudo[98831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b.6ed3d37a-1c46-45de-bef9-0eeffd11a2e7 1G Jul 21 02:15:37 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:38 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d46e6366-2a5d-4ecf-a0ee-e16534fd808c tempest-TestStampPattern-361473491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b.6ed3d37a-1c46-45de-bef9-0eeffd11a2e7 1G" returned: 0 in 0.605s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d46e6366-2a5d-4ecf-a0ee-e16534fd808c tempest-TestStampPattern-361473491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-524d5171-eb4e-4c04-bfff-1f6acf19972b -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b.6ed3d37a-1c46-45de-bef9-0eeffd11a2e7 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:38 devstack sudo[98836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-524d5171-eb4e-4c04-bfff-1f6acf19972b -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b.6ed3d37a-1c46-45de-bef9-0eeffd11a2e7 Jul 21 02:15:38 devstack sudo[98836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:38 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:15:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Flow 'volume_create_manager' (d2d0916d-269d-4799-98e4-16af2c04870f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:15:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607d4877-c0e3-4a7e-a935-25e4a00dfd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607d4877-c0e3-4a7e-a935-25e4a00dfd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2072514185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c480d655-da0e-407c-a7b7-87b18bbcbddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fafd5f9ce40c480b89a8fd722e218fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:15:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=0b547a0a-905d-4382-ac81-ca254b0e4d69,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:15:38Z,use_quota=True,user_id='5c45bddde11846bb8e7c689ff55f5a27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a9aab9-de6f-45d4-8cd0-5cbfb060b0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a9aab9-de6f-45d4-8cd0-5cbfb060b0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (526c5b53-edc4-4c85-8fa6-76d0056aafd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (526c5b53-edc4-4c85-8fa6-76d0056aafd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c480d655-da0e-407c-a7b7-87b18bbcbddc', 'volume_name': 'volume-c480d655-da0e-407c-a7b7-87b18bbcbddc', 'volume_size': 2, 'snapshot_id': '0b547a0a-905d-4382-ac81-ca254b0e4d69'}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26a5d316-9603-4a5a-be7f-1f511b3bf689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26a5d316-9603-4a5a-be7f-1f511b3bf689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8307a472-f038-4d99-bcfd-3962c2d940ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:38 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Volume c480d655-da0e-407c-a7b7-87b18bbcbddc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c480d655-da0e-407c-a7b7-87b18bbcbddc', 'volume_size': 2, 'snapshot_id': '0b547a0a-905d-4382-ac81-ca254b0e4d69'} Jul 21 02:15:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:15:38 devstack sudo[98836]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d46e6366-2a5d-4ecf-a0ee-e16534fd808c tempest-TestStampPattern-361473491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-524d5171-eb4e-4c04-bfff-1f6acf19972b -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b.6ed3d37a-1c46-45de-bef9-0eeffd11a2e7" returned: 0 in 0.388s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:38 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-d46e6366-2a5d-4ecf-a0ee-e16534fd808c tempest-TestStampPattern-361473491 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b.6ed3d37a-1c46-45de-bef9-0eeffd11a2e7 is being set with open permissions: ugo+rw Jul 21 02:15:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d46e6366-2a5d-4ecf-a0ee-e16534fd808c tempest-TestStampPattern-361473491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b.6ed3d37a-1c46-45de-bef9-0eeffd11a2e7 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:38 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b.6ed3d37a-1c46-45de-bef9-0eeffd11a2e7 Jul 21 02:15:38 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:39 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d46e6366-2a5d-4ecf-a0ee-e16534fd808c tempest-TestStampPattern-361473491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b.6ed3d37a-1c46-45de-bef9-0eeffd11a2e7" returned: 0 in 0.334s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d46e6366-2a5d-4ecf-a0ee-e16534fd808c tempest-TestStampPattern-361473491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:39 devstack sudo[98844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b.info Jul 21 02:15:39 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:39 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d46e6366-2a5d-4ecf-a0ee-e16534fd808c tempest-TestStampPattern-361473491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b.info" returned: 0 in 0.269s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:39 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-d46e6366-2a5d-4ecf-a0ee-e16534fd808c tempest-TestStampPattern-361473491 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b.info is being set with open permissions: ugo+rw Jul 21 02:15:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d46e6366-2a5d-4ecf-a0ee-e16534fd808c tempest-TestStampPattern-361473491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:39 devstack sudo[98847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b.info Jul 21 02:15:39 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:39 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d46e6366-2a5d-4ecf-a0ee-e16534fd808c tempest-TestStampPattern-361473491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b.info" returned: 0 in 0.313s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d46e6366-2a5d-4ecf-a0ee-e16534fd808c tempest-TestStampPattern-361473491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.435s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:15:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.058s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:15:39 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "cinder-quobyte-0b547a0a-905d-4382-ac81-ca254b0e4d69-c480d655-da0e-407c-a7b7-87b18bbcbddc" by "_create_volume_from_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:15:39 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-quobyte-0b547a0a-905d-4382-ac81-ca254b0e4d69-c480d655-da0e-407c-a7b7-87b18bbcbddc" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:15:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Creating volume c480d655-da0e-407c-a7b7-87b18bbcbddc from snapshot 0b547a0a-905d-4382-ac81-ca254b0e4d69 {{(pid=87566) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 02:15:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:15:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:15:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:15:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:15:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:15:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:15:39 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "cinder-quobyte-c480d655-da0e-407c-a7b7-87b18bbcbddc" by "_copy_volume_from_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:15:39 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-d46e6366-2a5d-4ecf-a0ee-e16534fd808c tempest-TestStampPattern-361473491 None] Create snapshot completed successfully Jul 21 02:15:39 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-quobyte-c480d655-da0e-407c-a7b7-87b18bbcbddc" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:15:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] snapshot: 0b547a0a-905d-4382-ac81-ca254b0e4d69, volume: c480d655-da0e-407c-a7b7-87b18bbcbddc, {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 02:15:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:15:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:15:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:15:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:15:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:15:39 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f26db1f-8e70-4ae9-b652-1eac3f857260]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:15:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1.0b547a0a-905d-4382-ac81-ca254b0e4d69 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:39 devstack sudo[98850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1.0b547a0a-905d-4382-ac81-ca254b0e4d69 Jul 21 02:15:39 devstack sudo[98850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:40 devstack sudo[98850]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1.0b547a0a-905d-4382-ac81-ca254b0e4d69" returned: 0 in 0.427s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:40 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:15:40 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1 {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 02:15:40 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Creating direct copy from snapshot {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 02:15:40 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dfae6a-e95b-4162-be7a-17fcaa2d426d]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:15:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:40 devstack sudo[98855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1 Jul 21 02:15:40 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:40 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1" returned: 0 in 0.440s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:40 devstack cinder-volume[87566]: DEBUG cinder.utils [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Path /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c480d655-da0e-407c-a7b7-87b18bbcbddc not found in is_blk_device check {{(pid=87566) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 02:15:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c480d655-da0e-407c-a7b7-87b18bbcbddc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:40 devstack sudo[98860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c480d655-da0e-407c-a7b7-87b18bbcbddc Jul 21 02:15:40 devstack sudo[98860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:42 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:15:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] Flow 'volume_create_manager' (2d438f80-f6fb-4419-b1e7-53454cd89a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:15:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b97523-a4d8-41c9-8d80-bd302acfaa54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b97523-a4d8-41c9-8d80-bd302acfaa54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1885247348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8060e2d7-165c-4d87-b01d-814fbab0cad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33be483565f1450db68ad04c52b58238',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:15:43Z,use_quota=True,user_id='43db1620a847494a91328a437454e7d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd575a71-31d3-43b2-9fb8-666c189a9d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd575a71-31d3-43b2-9fb8-666c189a9d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3cd99e-937f-49a2-9b89-e8f9dc809fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3cd99e-937f-49a2-9b89-e8f9dc809fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8060e2d7-165c-4d87-b01d-814fbab0cad2', 'volume_name': 'volume-8060e2d7-165c-4d87-b01d-814fbab0cad2', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22a0406-095b-408d-b978-0bb2a7e9f994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22a0406-095b-408d-b978-0bb2a7e9f994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4fa5e7b-309c-40f7-a9b2-d4f030573be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:43 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] Volume 8060e2d7-165c-4d87-b01d-814fbab0cad2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8060e2d7-165c-4d87-b01d-814fbab0cad2', 'volume_size': 1} Jul 21 02:15:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:15:46 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:15:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Flow 'volume_create_manager' (4ee2280a-07c4-4ef1-9eb6-1ac97a39ddce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:15:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad1254a-ffd5-46a8-88c5-2f3daed065bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad1254a-ffd5-46a8-88c5-2f3daed065bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-587887859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c6fd0d-3f7d-4352-833c-b8433e75abfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b74ba5da7d004a638120ce22e922da30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:15:46Z,use_quota=True,user_id='89a50d40e5d044e69e7fcc1187f8831e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe7fe22-d173-496c-ba59-1a24fc7b25b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe7fe22-d173-496c-ba59-1a24fc7b25b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed261bac-325b-4345-876d-43b8a6d4bf64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed261bac-325b-4345-876d-43b8a6d4bf64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78c6fd0d-3f7d-4352-833c-b8433e75abfc', 'volume_name': 'volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd2ad089-1108-41d6-a54e-3ac191eaa46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd2ad089-1108-41d6-a54e-3ac191eaa46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d4ab76d-af29-44e9-bbe4-dec33aa3fcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:46 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Volume 78c6fd0d-3f7d-4352-833c-b8433e75abfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc', 'volume_size': 1} Jul 21 02:15:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:15:46 devstack sudo[98860]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c480d655-da0e-407c-a7b7-87b18bbcbddc" returned: 0 in 5.929s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:46 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[af05a821-a404-494e-b33f-6eba396f973d]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:15:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:46 devstack sudo[98902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1 Jul 21 02:15:46 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:47 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1" returned: 0 in 0.564s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:47 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Image conversion details: src /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1, size 1024.00 MB, duration 5.93 sec, destination /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c480d655-da0e-407c-a7b7-87b18bbcbddc {{(pid=87566) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 02:15:47 devstack cinder-volume[87566]: INFO cinder.image.image_utils [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Converted 1024.00 MB image at 172.70 MB/s Jul 21 02:15:47 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c480d655-da0e-407c-a7b7-87b18bbcbddc is being set with open permissions: ugo+rw Jul 21 02:15:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c480d655-da0e-407c-a7b7-87b18bbcbddc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:47 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c480d655-da0e-407c-a7b7-87b18bbcbddc Jul 21 02:15:47 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:47 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c480d655-da0e-407c-a7b7-87b18bbcbddc" returned: 0 in 0.260s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-quobyte-c480d655-da0e-407c-a7b7-87b18bbcbddc" released by "_copy_volume_from_snapshot" :: held 7.731s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:15:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-quobyte-0b547a0a-905d-4382-ac81-ca254b0e4d69-c480d655-da0e-407c-a7b7-87b18bbcbddc" released by "_create_volume_from_snapshot" :: held 7.771s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:15:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.805s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:15:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.465s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:15:47 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1885247348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8060e2d7-165c-4d87-b01d-814fbab0cad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33be483565f1450db68ad04c52b58238',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:15:43Z,use_quota=True,user_id='43db1620a847494a91328a437454e7d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:15:47 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] Creating volume 8060e2d7-165c-4d87-b01d-814fbab0cad2 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:15:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:15:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:15:47 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:15:47 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:15:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:15:47 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:15:47 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:15:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:47 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2 1073741824 Jul 21 02:15:47 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8307a472-f038-4d99-bcfd-3962c2d940ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c480d655-da0e-407c-a7b7-87b18bbcbddc', 'volume_size': 2, 'snapshot_id': '0b547a0a-905d-4382-ac81-ca254b0e4d69'}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e011e64c-b454-4f7d-a03f-9188ad6e6512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:47 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Volume volume-c480d655-da0e-407c-a7b7-87b18bbcbddc (c480d655-da0e-407c-a7b7-87b18bbcbddc): created successfully Jul 21 02:15:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e011e64c-b454-4f7d-a03f-9188ad6e6512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Flow 'volume_create_manager' (d2d0916d-269d-4799-98e4-16af2c04870f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:15:47 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-2bf8ef33-0e95-4ecd-a913-a48d8e831c8f tempest-VolumesSnapshotTestJSON-660412331 None] Created volume successfully. Jul 21 02:15:47 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2 1073741824" returned: 0 in 0.432s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:47 devstack sudo[98917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2 Jul 21 02:15:47 devstack sudo[98917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:48 devstack sudo[98917]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2" returned: 0 in 0.265s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:15:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:15:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.940s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:15:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-587887859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c6fd0d-3f7d-4352-833c-b8433e75abfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b74ba5da7d004a638120ce22e922da30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:15:46Z,use_quota=True,user_id='89a50d40e5d044e69e7fcc1187f8831e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:15:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Creating volume 78c6fd0d-3f7d-4352-833c-b8433e75abfc {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:15:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:15:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:15:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:15:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:15:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:15:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:15:48 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:15:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4fa5e7b-309c-40f7-a9b2-d4f030573be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8060e2d7-165c-4d87-b01d-814fbab0cad2', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb2f02e-0f14-4e45-b3f2-37445d41a8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:48 devstack sudo[98920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc 1073741824 Jul 21 02:15:48 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:48 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] Volume volume-8060e2d7-165c-4d87-b01d-814fbab0cad2 (8060e2d7-165c-4d87-b01d-814fbab0cad2): created successfully Jul 21 02:15:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb2f02e-0f14-4e45-b3f2-37445d41a8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] Flow 'volume_create_manager' (2d438f80-f6fb-4419-b1e7-53454cd89a0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:15:48 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-2a0680fb-e5ae-40b5-ab4d-71d0401fe0e4 tempest-SnapshotMetadataTestJSON-337157172 None] Created volume successfully. Jul 21 02:15:48 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-88f80f97-d47c-447b-9324-68a3b472ef3c tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "cinder-c480d655-da0e-407c-a7b7-87b18bbcbddc-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:15:48 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-88f80f97-d47c-447b-9324-68a3b472ef3c tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-c480d655-da0e-407c-a7b7-87b18bbcbddc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:15:48 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-88f80f97-d47c-447b-9324-68a3b472ef3c tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "cinder-quobyte-c480d655-da0e-407c-a7b7-87b18bbcbddc" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:15:48 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-88f80f97-d47c-447b-9324-68a3b472ef3c tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-quobyte-c480d655-da0e-407c-a7b7-87b18bbcbddc" acquired by "delete_volume" :: waited 0.031s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:15:48 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc 1073741824" returned: 0 in 0.582s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:48 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[373e13c2-2976-4185-8b8e-2ea89d7b5455]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:15:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-88f80f97-d47c-447b-9324-68a3b472ef3c tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c480d655-da0e-407c-a7b7-87b18bbcbddc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:48 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:15:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:15:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:15:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:15:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:15:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:15:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:48 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc Jul 21 02:15:48 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:48 devstack sudo[98928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:15:48 devstack sudo[98928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:48 devstack sudo[98926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c480d655-da0e-407c-a7b7-87b18bbcbddc Jul 21 02:15:48 devstack sudo[98926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:49 devstack sudo[98928]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:49 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc" returned: 0 in 0.368s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.348s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:15:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:15:49 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:15:49 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager._thread_info {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:15:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread count: 28 {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 02:15:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread info: [<_MainThread(MainThread, started 135786703114368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 02:15:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d4ab76d-af29-44e9-bbe4-dec33aa3fcea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd4f6e6-5942-46e3-acd0-4cd84c048736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:49 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Volume volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc (78c6fd0d-3f7d-4352-833c-b8433e75abfc): created successfully Jul 21 02:15:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd4f6e6-5942-46e3-acd0-4cd84c048736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Flow 'volume_create_manager' (4ee2280a-07c4-4ef1-9eb6-1ac97a39ddce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:15:49 devstack sudo[98926]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-88f80f97-d47c-447b-9324-68a3b472ef3c tempest-VolumesSnapshotTestJSON-660412331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c480d655-da0e-407c-a7b7-87b18bbcbddc" returned: 0 in 0.512s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-88f80f97-d47c-447b-9324-68a3b472ef3c tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c480d655-da0e-407c-a7b7-87b18bbcbddc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:49 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-e4bbed57-6eef-4e16-9b76-9454ec2c231a tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Created volume successfully. Jul 21 02:15:49 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c480d655-da0e-407c-a7b7-87b18bbcbddc Jul 21 02:15:49 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f099e84a-3744-4143-89ed-777a695230a1 tempest-SnapshotMetadataTestJSON-337157172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:15:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f099e84a-3744-4143-89ed-777a695230a1 tempest-SnapshotMetadataTestJSON-337157172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:15:49 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-88f80f97-d47c-447b-9324-68a3b472ef3c tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c480d655-da0e-407c-a7b7-87b18bbcbddc" returned: 0 in 0.307s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-f099e84a-3744-4143-89ed-777a695230a1 tempest-SnapshotMetadataTestJSON-337157172 None] Creating offline snapshot fa045b3f-713f-4c95-96ad-4a1ddb1a4c1c of volume 8060e2d7-165c-4d87-b01d-814fbab0cad2 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:15:49 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-88f80f97-d47c-447b-9324-68a3b472ef3c tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-quobyte-c480d655-da0e-407c-a7b7-87b18bbcbddc" released by "delete_volume" :: held 0.882s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:15:49 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[18020d8d-3462-449c-b2e2-92a8d70b28e9]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:15:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f099e84a-3744-4143-89ed-777a695230a1 tempest-SnapshotMetadataTestJSON-337157172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:49 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-88f80f97-d47c-447b-9324-68a3b472ef3c tempest-VolumesSnapshotTestJSON-660412331 None] Created reservations ['8e1b7317-3d6d-4643-bb17-179804f1cdf4', '5af139e8-9701-41d7-adcd-24be1db201c1', '787ac106-b56b-4776-8d05-542ebd866f00', '1e951931-012b-4b5d-a0ce-83624000f59a'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:15:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-88f80f97-d47c-447b-9324-68a3b472ef3c tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:15:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-88f80f97-d47c-447b-9324-68a3b472ef3c tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:15:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-88f80f97-d47c-447b-9324-68a3b472ef3c tempest-VolumesSnapshotTestJSON-660412331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:15:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-88f80f97-d47c-447b-9324-68a3b472ef3c tempest-VolumesSnapshotTestJSON-660412331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:15:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-88f80f97-d47c-447b-9324-68a3b472ef3c tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:15:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-88f80f97-d47c-447b-9324-68a3b472ef3c tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:49 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2 Jul 21 02:15:49 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:49 devstack sudo[98942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:15:49 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:49 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-22627026-02a2-4198-b300-4d5dc26ce537 tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "cinder-0b547a0a-905d-4382-ac81-ca254b0e4d69-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:15:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-22627026-02a2-4198-b300-4d5dc26ce537 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-0b547a0a-905d-4382-ac81-ca254b0e4d69-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:15:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-22627026-02a2-4198-b300-4d5dc26ce537 tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "cinder-quobyte-3cefabc5-1e44-4b98-8914-7577f2f9a4a1" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:15:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-22627026-02a2-4198-b300-4d5dc26ce537 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-quobyte-3cefabc5-1e44-4b98-8914-7577f2f9a4a1" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:15:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-22627026-02a2-4198-b300-4d5dc26ce537 tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "cinder-quobyte-0b547a0a-905d-4382-ac81-ca254b0e4d69" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:15:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-22627026-02a2-4198-b300-4d5dc26ce537 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-quobyte-0b547a0a-905d-4382-ac81-ca254b0e4d69" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:15:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-22627026-02a2-4198-b300-4d5dc26ce537 tempest-VolumesSnapshotTestJSON-660412331 None] Deleting offline snapshot 0b547a0a-905d-4382-ac81-ca254b0e4d69 of volume 3cefabc5-1e44-4b98-8914-7577f2f9a4a1 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:15:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-22627026-02a2-4198-b300-4d5dc26ce537 tempest-VolumesSnapshotTestJSON-660412331 None] snapshot_file for this snap is: volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1.0b547a0a-905d-4382-ac81-ca254b0e4d69 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:15:50 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b81d5a5-958f-4e0f-b40c-fff8d0ac788d]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:15:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-22627026-02a2-4198-b300-4d5dc26ce537 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1.0b547a0a-905d-4382-ac81-ca254b0e4d69 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:50 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f099e84a-3744-4143-89ed-777a695230a1 tempest-SnapshotMetadataTestJSON-337157172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2" returned: 0 in 0.424s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f099e84a-3744-4143-89ed-777a695230a1 tempest-SnapshotMetadataTestJSON-337157172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2.fa045b3f-713f-4c95-96ad-4a1ddb1a4c1c 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:50 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-88f80f97-d47c-447b-9324-68a3b472ef3c tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.304s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:50 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-88f80f97-d47c-447b-9324-68a3b472ef3c tempest-VolumesSnapshotTestJSON-660412331 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:15:50 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-88f80f97-d47c-447b-9324-68a3b472ef3c tempest-VolumesSnapshotTestJSON-660412331 None] Deleted volume successfully. Jul 21 02:15:50 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2.fa045b3f-713f-4c95-96ad-4a1ddb1a4c1c 1G Jul 21 02:15:50 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-88f80f97-d47c-447b-9324-68a3b472ef3c tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-c480d655-da0e-407c-a7b7-87b18bbcbddc-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:15:50 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1.0b547a0a-905d-4382-ac81-ca254b0e4d69 Jul 21 02:15:50 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:50 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-22627026-02a2-4198-b300-4d5dc26ce537 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1.0b547a0a-905d-4382-ac81-ca254b0e4d69" returned: 0 in 0.442s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-22627026-02a2-4198-b300-4d5dc26ce537 tempest-VolumesSnapshotTestJSON-660412331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:15:50 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8d4bc4-8f0e-433e-a97f-e6fc95c84b05]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:15:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-22627026-02a2-4198-b300-4d5dc26ce537 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:50 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f099e84a-3744-4143-89ed-777a695230a1 tempest-SnapshotMetadataTestJSON-337157172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2.fa045b3f-713f-4c95-96ad-4a1ddb1a4c1c 1G" returned: 0 in 0.535s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f099e84a-3744-4143-89ed-777a695230a1 tempest-SnapshotMetadataTestJSON-337157172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8060e2d7-165c-4d87-b01d-814fbab0cad2 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2.fa045b3f-713f-4c95-96ad-4a1ddb1a4c1c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:50 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8060e2d7-165c-4d87-b01d-814fbab0cad2 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2.fa045b3f-713f-4c95-96ad-4a1ddb1a4c1c Jul 21 02:15:50 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:50 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1 Jul 21 02:15:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cb823d96-a338-422a-906b-fde58d420a2c tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:15:50 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:50 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:15:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Flow 'volume_create_manager' (ef3276d0-19e5-432e-abf5-5d1c683cd5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:15:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b574d1c2-055f-4668-a8dc-05e8b6a31bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b574d1c2-055f-4668-a8dc-05e8b6a31bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-311337665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1790d7c5-4bb0-4564-a02f-2b1750332755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b46a9ccbd444dbcb99790deb26b6e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6ed3d37a-1c46-45de-bef9-0eeffd11a2e7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:15:51Z,use_quota=True,user_id='1784cfe2817448c8be8ada3439931b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75454c0b-dcec-4cc9-9373-47494d398908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75454c0b-dcec-4cc9-9373-47494d398908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:51 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c757c2c2-8c2f-4699-8e4a-a8334a44defb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c757c2c2-8c2f-4699-8e4a-a8334a44defb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1790d7c5-4bb0-4564-a02f-2b1750332755', 'volume_name': 'volume-1790d7c5-4bb0-4564-a02f-2b1750332755', 'volume_size': 1, 'snapshot_id': '6ed3d37a-1c46-45de-bef9-0eeffd11a2e7'}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b33f5dcf-5e9f-42d2-a85a-244a13faa937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b33f5dcf-5e9f-42d2-a85a-244a13faa937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa9b7e32-a195-4c3a-af0e-a8361add6e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:51 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Volume 1790d7c5-4bb0-4564-a02f-2b1750332755: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1790d7c5-4bb0-4564-a02f-2b1750332755', 'volume_size': 1, 'snapshot_id': '6ed3d37a-1c46-45de-bef9-0eeffd11a2e7'} Jul 21 02:15:51 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f099e84a-3744-4143-89ed-777a695230a1 tempest-SnapshotMetadataTestJSON-337157172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8060e2d7-165c-4d87-b01d-814fbab0cad2 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2.fa045b3f-713f-4c95-96ad-4a1ddb1a4c1c" returned: 0 in 0.490s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:51 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-f099e84a-3744-4143-89ed-777a695230a1 tempest-SnapshotMetadataTestJSON-337157172 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2.fa045b3f-713f-4c95-96ad-4a1ddb1a4c1c is being set with open permissions: ugo+rw Jul 21 02:15:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f099e84a-3744-4143-89ed-777a695230a1 tempest-SnapshotMetadataTestJSON-337157172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2.fa045b3f-713f-4c95-96ad-4a1ddb1a4c1c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-22627026-02a2-4198-b300-4d5dc26ce537 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1" returned: 0 in 0.596s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-22627026-02a2-4198-b300-4d5dc26ce537 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1.0b547a0a-905d-4382-ac81-ca254b0e4d69 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:51 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2.fa045b3f-713f-4c95-96ad-4a1ddb1a4c1c Jul 21 02:15:51 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:15:51 devstack sudo[98976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1.0b547a0a-905d-4382-ac81-ca254b0e4d69 Jul 21 02:15:51 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:51 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f099e84a-3744-4143-89ed-777a695230a1 tempest-SnapshotMetadataTestJSON-337157172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2.fa045b3f-713f-4c95-96ad-4a1ddb1a4c1c" returned: 0 in 0.289s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f099e84a-3744-4143-89ed-777a695230a1 tempest-SnapshotMetadataTestJSON-337157172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:51 devstack sudo[98984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2.info Jul 21 02:15:51 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:51 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-22627026-02a2-4198-b300-4d5dc26ce537 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1.0b547a0a-905d-4382-ac81-ca254b0e4d69" returned: 0 in 0.366s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-22627026-02a2-4198-b300-4d5dc26ce537 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1.0b547a0a-905d-4382-ac81-ca254b0e4d69 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:51 devstack sudo[98986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1.0b547a0a-905d-4382-ac81-ca254b0e4d69 Jul 21 02:15:51 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:51 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f099e84a-3744-4143-89ed-777a695230a1 tempest-SnapshotMetadataTestJSON-337157172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2.info" returned: 0 in 0.298s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:51 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-f099e84a-3744-4143-89ed-777a695230a1 tempest-SnapshotMetadataTestJSON-337157172 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2.info is being set with open permissions: ugo+rw Jul 21 02:15:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f099e84a-3744-4143-89ed-777a695230a1 tempest-SnapshotMetadataTestJSON-337157172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:51 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-22627026-02a2-4198-b300-4d5dc26ce537 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1.0b547a0a-905d-4382-ac81-ca254b0e4d69" returned: 0 in 0.267s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:51 devstack sudo[98990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2.info Jul 21 02:15:51 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:51 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-22627026-02a2-4198-b300-4d5dc26ce537 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-quobyte-0b547a0a-905d-4382-ac81-ca254b0e4d69" released by "_delete_snapshot" :: held 1.786s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:15:51 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-22627026-02a2-4198-b300-4d5dc26ce537 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-quobyte-3cefabc5-1e44-4b98-8914-7577f2f9a4a1" released by "delete_snapshot" :: held 1.822s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:15:51 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-22627026-02a2-4198-b300-4d5dc26ce537 tempest-VolumesSnapshotTestJSON-660412331 None] Created reservations ['221beb11-082c-4970-8eaa-e20c147b9fa9', 'baa3201d-12d1-48a3-8ec8-8611d2de091a', '28dc7a79-50c9-4a95-a0ac-6c123ddd235a', '339e7a93-63ef-435b-9921-2003868fff87'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:15:51 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-22627026-02a2-4198-b300-4d5dc26ce537 tempest-VolumesSnapshotTestJSON-660412331 None] Delete snapshot completed successfully. Jul 21 02:15:52 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-22627026-02a2-4198-b300-4d5dc26ce537 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-0b547a0a-905d-4382-ac81-ca254b0e4d69-delete_snapshot" released by "delete_snapshot" :: held 1.997s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:15:52 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f099e84a-3744-4143-89ed-777a695230a1 tempest-SnapshotMetadataTestJSON-337157172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2.info" returned: 0 in 0.285s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f099e84a-3744-4143-89ed-777a695230a1 tempest-SnapshotMetadataTestJSON-337157172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.508s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:15:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cb823d96-a338-422a-906b-fde58d420a2c tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.332s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:15:52 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-cb823d96-a338-422a-906b-fde58d420a2c tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Creating offline snapshot 80887c49-27cb-4694-8bff-414f60c55821 of volume 78c6fd0d-3f7d-4352-833c-b8433e75abfc {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:15:52 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-f099e84a-3744-4143-89ed-777a695230a1 tempest-SnapshotMetadataTestJSON-337157172 None] Create snapshot completed successfully Jul 21 02:15:52 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[447b63c9-2b5f-48d6-8100-80cb989a20d7]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:15:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb823d96-a338-422a-906b-fde58d420a2c tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:52 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c8a6954f-cf2e-4224-b1c0-f85176771051 tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "cinder-3cefabc5-1e44-4b98-8914-7577f2f9a4a1-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:15:52 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c8a6954f-cf2e-4224-b1c0-f85176771051 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-3cefabc5-1e44-4b98-8914-7577f2f9a4a1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:15:52 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c8a6954f-cf2e-4224-b1c0-f85176771051 tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "cinder-quobyte-3cefabc5-1e44-4b98-8914-7577f2f9a4a1" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:15:52 devstack sudo[99030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc Jul 21 02:15:52 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c8a6954f-cf2e-4224-b1c0-f85176771051 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-quobyte-3cefabc5-1e44-4b98-8914-7577f2f9a4a1" acquired by "delete_volume" :: waited 0.029s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:15:52 devstack sudo[99030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:52 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ad3160-8658-44bf-b66e-0399c1486477]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:15:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c8a6954f-cf2e-4224-b1c0-f85176771051 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:52 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1 Jul 21 02:15:52 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:52 devstack sudo[99030]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb823d96-a338-422a-906b-fde58d420a2c tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc" returned: 0 in 0.548s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb823d96-a338-422a-906b-fde58d420a2c tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc.80887c49-27cb-4694-8bff-414f60c55821 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:52 devstack sudo[99040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc.80887c49-27cb-4694-8bff-414f60c55821 1G Jul 21 02:15:52 devstack sudo[99040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:52 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c8a6954f-cf2e-4224-b1c0-f85176771051 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1" returned: 0 in 0.532s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c8a6954f-cf2e-4224-b1c0-f85176771051 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:53 devstack sudo[99045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1 Jul 21 02:15:53 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:53 devstack sudo[99040]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb823d96-a338-422a-906b-fde58d420a2c tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc.80887c49-27cb-4694-8bff-414f60c55821 1G" returned: 0 in 0.565s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb823d96-a338-422a-906b-fde58d420a2c tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc.80887c49-27cb-4694-8bff-414f60c55821 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:53 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc.80887c49-27cb-4694-8bff-414f60c55821 Jul 21 02:15:53 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:53 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c8a6954f-cf2e-4224-b1c0-f85176771051 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3cefabc5-1e44-4b98-8914-7577f2f9a4a1" returned: 0 in 0.414s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:53 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c8a6954f-cf2e-4224-b1c0-f85176771051 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-quobyte-3cefabc5-1e44-4b98-8914-7577f2f9a4a1" released by "delete_volume" :: held 1.047s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:15:53 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-c8a6954f-cf2e-4224-b1c0-f85176771051 tempest-VolumesSnapshotTestJSON-660412331 None] Created reservations ['69369a14-c242-48c7-afb7-def5eb8b258b', '856258ea-76cd-454c-8b9e-d8d4209c7406', '13eb2475-2ffc-468c-b3ae-bca0412bc162', '8996af67-7c91-46f8-9dd5-f29e0550aa00'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:15:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c8a6954f-cf2e-4224-b1c0-f85176771051 tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:15:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c8a6954f-cf2e-4224-b1c0-f85176771051 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:15:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c8a6954f-cf2e-4224-b1c0-f85176771051 tempest-VolumesSnapshotTestJSON-660412331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:15:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c8a6954f-cf2e-4224-b1c0-f85176771051 tempest-VolumesSnapshotTestJSON-660412331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:15:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c8a6954f-cf2e-4224-b1c0-f85176771051 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:15:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c8a6954f-cf2e-4224-b1c0-f85176771051 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:53 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:15:53 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:53 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb823d96-a338-422a-906b-fde58d420a2c tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc.80887c49-27cb-4694-8bff-414f60c55821" returned: 0 in 0.492s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:53 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-cb823d96-a338-422a-906b-fde58d420a2c tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc.80887c49-27cb-4694-8bff-414f60c55821 is being set with open permissions: ugo+rw Jul 21 02:15:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb823d96-a338-422a-906b-fde58d420a2c tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc.80887c49-27cb-4694-8bff-414f60c55821 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:53 devstack sudo[99062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc.80887c49-27cb-4694-8bff-414f60c55821 Jul 21 02:15:53 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:54 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3f7fdf26-68dd-4a7d-b928-c708f5dbc438 tempest-SnapshotMetadataTestJSON-337157172 None] Acquiring lock "cinder-fa045b3f-713f-4c95-96ad-4a1ddb1a4c1c-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:15:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c8a6954f-cf2e-4224-b1c0-f85176771051 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.380s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:54 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-c8a6954f-cf2e-4224-b1c0-f85176771051 tempest-VolumesSnapshotTestJSON-660412331 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:15:54 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-c8a6954f-cf2e-4224-b1c0-f85176771051 tempest-VolumesSnapshotTestJSON-660412331 None] Deleted volume successfully. Jul 21 02:15:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3f7fdf26-68dd-4a7d-b928-c708f5dbc438 tempest-SnapshotMetadataTestJSON-337157172 None] Lock "cinder-fa045b3f-713f-4c95-96ad-4a1ddb1a4c1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:15:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3f7fdf26-68dd-4a7d-b928-c708f5dbc438 tempest-SnapshotMetadataTestJSON-337157172 None] Acquiring lock "cinder-quobyte-8060e2d7-165c-4d87-b01d-814fbab0cad2" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:15:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3f7fdf26-68dd-4a7d-b928-c708f5dbc438 tempest-SnapshotMetadataTestJSON-337157172 None] Lock "cinder-quobyte-8060e2d7-165c-4d87-b01d-814fbab0cad2" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:15:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3f7fdf26-68dd-4a7d-b928-c708f5dbc438 tempest-SnapshotMetadataTestJSON-337157172 None] Acquiring lock "cinder-quobyte-fa045b3f-713f-4c95-96ad-4a1ddb1a4c1c" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:15:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c8a6954f-cf2e-4224-b1c0-f85176771051 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-3cefabc5-1e44-4b98-8914-7577f2f9a4a1-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:15:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3f7fdf26-68dd-4a7d-b928-c708f5dbc438 tempest-SnapshotMetadataTestJSON-337157172 None] Lock "cinder-quobyte-fa045b3f-713f-4c95-96ad-4a1ddb1a4c1c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:15:54 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-3f7fdf26-68dd-4a7d-b928-c708f5dbc438 tempest-SnapshotMetadataTestJSON-337157172 None] Deleting offline snapshot fa045b3f-713f-4c95-96ad-4a1ddb1a4c1c of volume 8060e2d7-165c-4d87-b01d-814fbab0cad2 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:15:54 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-3f7fdf26-68dd-4a7d-b928-c708f5dbc438 tempest-SnapshotMetadataTestJSON-337157172 None] snapshot_file for this snap is: volume-8060e2d7-165c-4d87-b01d-814fbab0cad2.fa045b3f-713f-4c95-96ad-4a1ddb1a4c1c {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:15:54 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46fd04c-0ecd-47c1-a685-397695f6eb4f]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:15:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3f7fdf26-68dd-4a7d-b928-c708f5dbc438 tempest-SnapshotMetadataTestJSON-337157172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2.fa045b3f-713f-4c95-96ad-4a1ddb1a4c1c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:54 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb823d96-a338-422a-906b-fde58d420a2c tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc.80887c49-27cb-4694-8bff-414f60c55821" returned: 0 in 0.518s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:54 devstack sudo[99065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2.fa045b3f-713f-4c95-96ad-4a1ddb1a4c1c Jul 21 02:15:54 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb823d96-a338-422a-906b-fde58d420a2c tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:54 devstack sudo[99068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc.info Jul 21 02:15:54 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:54 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb823d96-a338-422a-906b-fde58d420a2c tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc.info" returned: 0 in 0.433s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:54 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-cb823d96-a338-422a-906b-fde58d420a2c tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc.info is being set with open permissions: ugo+rw Jul 21 02:15:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb823d96-a338-422a-906b-fde58d420a2c tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:54 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3f7fdf26-68dd-4a7d-b928-c708f5dbc438 tempest-SnapshotMetadataTestJSON-337157172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2.fa045b3f-713f-4c95-96ad-4a1ddb1a4c1c" returned: 0 in 0.718s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:54 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-3f7fdf26-68dd-4a7d-b928-c708f5dbc438 tempest-SnapshotMetadataTestJSON-337157172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8060e2d7-165c-4d87-b01d-814fbab0cad2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:15:54 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc.info Jul 21 02:15:54 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:54 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc09574-9112-42e6-8e49-dfa3225d1601]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:15:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3f7fdf26-68dd-4a7d-b928-c708f5dbc438 tempest-SnapshotMetadataTestJSON-337157172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:55 devstack sudo[99077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2 Jul 21 02:15:55 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:55 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cb823d96-a338-422a-906b-fde58d420a2c tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc.info" returned: 0 in 0.396s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cb823d96-a338-422a-906b-fde58d420a2c tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.147s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.081s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Acquiring lock "cinder-quobyte-6ed3d37a-1c46-45de-bef9-0eeffd11a2e7-1790d7c5-4bb0-4564-a02f-2b1750332755" by "_create_volume_from_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Lock "cinder-quobyte-6ed3d37a-1c46-45de-bef9-0eeffd11a2e7-1790d7c5-4bb0-4564-a02f-2b1750332755" acquired by "_create_volume_from_snapshot" :: waited 0.053s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Creating volume 1790d7c5-4bb0-4564-a02f-2b1750332755 from snapshot 6ed3d37a-1c46-45de-bef9-0eeffd11a2e7 {{(pid=87566) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Acquiring lock "cinder-quobyte-1790d7c5-4bb0-4564-a02f-2b1750332755" by "_copy_volume_from_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:15:55 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-cb823d96-a338-422a-906b-fde58d420a2c tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Create snapshot completed successfully Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Lock "cinder-quobyte-1790d7c5-4bb0-4564-a02f-2b1750332755" acquired by "_copy_volume_from_snapshot" :: waited 0.047s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] snapshot: 6ed3d37a-1c46-45de-bef9-0eeffd11a2e7, volume: 1790d7c5-4bb0-4564-a02f-2b1750332755, {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[c394f881-1c93-427e-93e7-0f4519dfe3e7]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b.6ed3d37a-1c46-45de-bef9-0eeffd11a2e7 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:55 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b.6ed3d37a-1c46-45de-bef9-0eeffd11a2e7 Jul 21 02:15:55 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:55 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3f7fdf26-68dd-4a7d-b928-c708f5dbc438 tempest-SnapshotMetadataTestJSON-337157172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2" returned: 0 in 0.780s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3f7fdf26-68dd-4a7d-b928-c708f5dbc438 tempest-SnapshotMetadataTestJSON-337157172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2.fa045b3f-713f-4c95-96ad-4a1ddb1a4c1c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:55 devstack sudo[99085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2.fa045b3f-713f-4c95-96ad-4a1ddb1a4c1c Jul 21 02:15:55 devstack sudo[99085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] Flow 'volume_create_manager' (6d1a8057-c7f8-49a3-83f5-63f31ee7285c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd04dd11-acd9-4294-9ca3-784e8107a704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd04dd11-acd9-4294-9ca3-784e8107a704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1667999407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a60349e9-d40a-45db-9c4a-7a3f1e7917a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fafd5f9ce40c480b89a8fd722e218fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:15:56Z,use_quota=True,user_id='5c45bddde11846bb8e7c689ff55f5a27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b981ecb-38a1-4921-bf3e-afd109fa95fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b981ecb-38a1-4921-bf3e-afd109fa95fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (375ba6f5-b10c-4ebf-82af-c03bb39b962b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (375ba6f5-b10c-4ebf-82af-c03bb39b962b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a60349e9-d40a-45db-9c4a-7a3f1e7917a6', 'volume_name': 'volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c4ea28-fc8f-4598-9c51-cb25c8847876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c4ea28-fc8f-4598-9c51-cb25c8847876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbc99a3f-89cf-4674-8766-5fda8f9a5359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:15:55 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] Volume a60349e9-d40a-45db-9c4a-7a3f1e7917a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6', 'volume_size': 1} Jul 21 02:15:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:15:56 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b.6ed3d37a-1c46-45de-bef9-0eeffd11a2e7" returned: 0 in 0.606s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-524d5171-eb4e-4c04-bfff-1f6acf19972b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:15:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 02:15:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Creating direct copy from snapshot {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 02:15:56 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5f09ae-687f-4a55-93fd-c003843dc9c4]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:15:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:56 devstack sudo[99100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b Jul 21 02:15:56 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:56 devstack sudo[99085]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3f7fdf26-68dd-4a7d-b928-c708f5dbc438 tempest-SnapshotMetadataTestJSON-337157172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2.fa045b3f-713f-4c95-96ad-4a1ddb1a4c1c" returned: 0 in 0.655s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3f7fdf26-68dd-4a7d-b928-c708f5dbc438 tempest-SnapshotMetadataTestJSON-337157172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2.fa045b3f-713f-4c95-96ad-4a1ddb1a4c1c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:56 devstack sudo[99104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2.fa045b3f-713f-4c95-96ad-4a1ddb1a4c1c Jul 21 02:15:56 devstack sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:56 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:56 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3aa2bf6e-2183-4439-9c38-80688f456ca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Acquiring lock "cinder-80887c49-27cb-4694-8bff-414f60c55821-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:15:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b" returned: 0 in 0.611s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:56 devstack cinder-volume[87566]: DEBUG cinder.utils [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Path /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1790d7c5-4bb0-4564-a02f-2b1750332755 not found in is_blk_device check {{(pid=87566) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 02:15:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1790d7c5-4bb0-4564-a02f-2b1750332755 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:56 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3aa2bf6e-2183-4439-9c38-80688f456ca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Lock "cinder-80887c49-27cb-4694-8bff-414f60c55821-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:15:56 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3aa2bf6e-2183-4439-9c38-80688f456ca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Acquiring lock "cinder-quobyte-78c6fd0d-3f7d-4352-833c-b8433e75abfc" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:15:56 devstack sudo[99104]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3f7fdf26-68dd-4a7d-b928-c708f5dbc438 tempest-SnapshotMetadataTestJSON-337157172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2.fa045b3f-713f-4c95-96ad-4a1ddb1a4c1c" returned: 0 in 0.442s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:56 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1790d7c5-4bb0-4564-a02f-2b1750332755 Jul 21 02:15:56 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:56 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3f7fdf26-68dd-4a7d-b928-c708f5dbc438 tempest-SnapshotMetadataTestJSON-337157172 None] Lock "cinder-quobyte-fa045b3f-713f-4c95-96ad-4a1ddb1a4c1c" released by "_delete_snapshot" :: held 2.767s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:15:56 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3aa2bf6e-2183-4439-9c38-80688f456ca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Lock "cinder-quobyte-78c6fd0d-3f7d-4352-833c-b8433e75abfc" acquired by "delete_snapshot" :: waited 0.073s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:15:56 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3aa2bf6e-2183-4439-9c38-80688f456ca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Acquiring lock "cinder-quobyte-80887c49-27cb-4694-8bff-414f60c55821" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:15:56 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3f7fdf26-68dd-4a7d-b928-c708f5dbc438 tempest-SnapshotMetadataTestJSON-337157172 None] Lock "cinder-quobyte-8060e2d7-165c-4d87-b01d-814fbab0cad2" released by "delete_snapshot" :: held 2.806s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:15:56 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3aa2bf6e-2183-4439-9c38-80688f456ca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Lock "cinder-quobyte-80887c49-27cb-4694-8bff-414f60c55821" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:15:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-3aa2bf6e-2183-4439-9c38-80688f456ca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Deleting offline snapshot 80887c49-27cb-4694-8bff-414f60c55821 of volume 78c6fd0d-3f7d-4352-833c-b8433e75abfc {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:15:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-3aa2bf6e-2183-4439-9c38-80688f456ca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] snapshot_file for this snap is: volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc.80887c49-27cb-4694-8bff-414f60c55821 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:15:57 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[daed1d51-2d63-4fd2-b29d-19fc6e00c3a0]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:15:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3aa2bf6e-2183-4439-9c38-80688f456ca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc.80887c49-27cb-4694-8bff-414f60c55821 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:57 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-3f7fdf26-68dd-4a7d-b928-c708f5dbc438 tempest-SnapshotMetadataTestJSON-337157172 None] Created reservations ['f96a6999-4a8d-48e0-b13b-7010559db95a', '4d30d2c1-32b2-48db-8c3b-1123c1aaf7f6', '866ecbe3-d984-4876-b343-12d31943135e', '78e0964a-40ba-49bf-9cbc-0304aff9c284'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:15:57 devstack sudo[99125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc.80887c49-27cb-4694-8bff-414f60c55821 Jul 21 02:15:57 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:57 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-3f7fdf26-68dd-4a7d-b928-c708f5dbc438 tempest-SnapshotMetadataTestJSON-337157172 None] Delete snapshot completed successfully. Jul 21 02:15:57 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3f7fdf26-68dd-4a7d-b928-c708f5dbc438 tempest-SnapshotMetadataTestJSON-337157172 None] Lock "cinder-fa045b3f-713f-4c95-96ad-4a1ddb1a4c1c-delete_snapshot" released by "delete_snapshot" :: held 3.224s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:15:57 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-942581d8-424e-41eb-80f4-65e14a5429de tempest-SnapshotMetadataTestJSON-337157172 None] Acquiring lock "cinder-8060e2d7-165c-4d87-b01d-814fbab0cad2-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:15:57 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-942581d8-424e-41eb-80f4-65e14a5429de tempest-SnapshotMetadataTestJSON-337157172 None] Lock "cinder-8060e2d7-165c-4d87-b01d-814fbab0cad2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:15:57 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-942581d8-424e-41eb-80f4-65e14a5429de tempest-SnapshotMetadataTestJSON-337157172 None] Acquiring lock "cinder-quobyte-8060e2d7-165c-4d87-b01d-814fbab0cad2" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:15:57 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-942581d8-424e-41eb-80f4-65e14a5429de tempest-SnapshotMetadataTestJSON-337157172 None] Lock "cinder-quobyte-8060e2d7-165c-4d87-b01d-814fbab0cad2" acquired by "delete_volume" :: waited 0.026s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:15:57 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3aa2bf6e-2183-4439-9c38-80688f456ca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc.80887c49-27cb-4694-8bff-414f60c55821" returned: 0 in 0.580s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:57 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-3aa2bf6e-2183-4439-9c38-80688f456ca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:15:57 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[e405cc8e-830f-4959-ba59-ec5e64674221]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:15:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-942581d8-424e-41eb-80f4-65e14a5429de tempest-SnapshotMetadataTestJSON-337157172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:57 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b682827-c869-419e-a045-3a854e6eb2d9]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:15:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3aa2bf6e-2183-4439-9c38-80688f456ca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:57 devstack sudo[99143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2 Jul 21 02:15:57 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:58 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc Jul 21 02:15:58 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:58 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-942581d8-424e-41eb-80f4-65e14a5429de tempest-SnapshotMetadataTestJSON-337157172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2" returned: 0 in 1.046s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-942581d8-424e-41eb-80f4-65e14a5429de tempest-SnapshotMetadataTestJSON-337157172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:58 devstack sudo[99175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2 Jul 21 02:15:58 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:59 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3aa2bf6e-2183-4439-9c38-80688f456ca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc" returned: 0 in 1.328s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3aa2bf6e-2183-4439-9c38-80688f456ca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc.80887c49-27cb-4694-8bff-414f60c55821 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:15:59 devstack sudo[99194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc.80887c49-27cb-4694-8bff-414f60c55821 Jul 21 02:15:59 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:15:59 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root Jul 21 02:15:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-942581d8-424e-41eb-80f4-65e14a5429de tempest-SnapshotMetadataTestJSON-337157172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8060e2d7-165c-4d87-b01d-814fbab0cad2" returned: 0 in 0.769s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:15:59 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-942581d8-424e-41eb-80f4-65e14a5429de tempest-SnapshotMetadataTestJSON-337157172 None] Lock "cinder-quobyte-8060e2d7-165c-4d87-b01d-814fbab0cad2" released by "delete_volume" :: held 1.988s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:15:59 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-942581d8-424e-41eb-80f4-65e14a5429de tempest-SnapshotMetadataTestJSON-337157172 None] Created reservations ['e3551338-7ad5-4fe8-ab47-1ec4c36e5b4a', 'dff67164-85ef-40c7-8a26-2ce8154ca3b3', '85fba635-995b-4378-a9fc-6b8d8830a018', '801fdba2-5f38-44fa-bfc0-e0d053773182'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:16:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-942581d8-424e-41eb-80f4-65e14a5429de tempest-SnapshotMetadataTestJSON-337157172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-942581d8-424e-41eb-80f4-65e14a5429de tempest-SnapshotMetadataTestJSON-337157172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:00 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-942581d8-424e-41eb-80f4-65e14a5429de tempest-SnapshotMetadataTestJSON-337157172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:16:00 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-942581d8-424e-41eb-80f4-65e14a5429de tempest-SnapshotMetadataTestJSON-337157172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:16:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-942581d8-424e-41eb-80f4-65e14a5429de tempest-SnapshotMetadataTestJSON-337157172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-942581d8-424e-41eb-80f4-65e14a5429de tempest-SnapshotMetadataTestJSON-337157172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:00 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:16:00 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:00 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3aa2bf6e-2183-4439-9c38-80688f456ca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc.80887c49-27cb-4694-8bff-414f60c55821" returned: 0 in 1.479s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3aa2bf6e-2183-4439-9c38-80688f456ca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc.80887c49-27cb-4694-8bff-414f60c55821 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:00 devstack sudo[99205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc.80887c49-27cb-4694-8bff-414f60c55821 Jul 21 02:16:00 devstack sudo[99205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:00 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-942581d8-424e-41eb-80f4-65e14a5429de tempest-SnapshotMetadataTestJSON-337157172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.825s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:00 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-942581d8-424e-41eb-80f4-65e14a5429de tempest-SnapshotMetadataTestJSON-337157172 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:16:01 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-942581d8-424e-41eb-80f4-65e14a5429de tempest-SnapshotMetadataTestJSON-337157172 None] Deleted volume successfully. Jul 21 02:16:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-942581d8-424e-41eb-80f4-65e14a5429de tempest-SnapshotMetadataTestJSON-337157172 None] Lock "cinder-8060e2d7-165c-4d87-b01d-814fbab0cad2-delete_volume" released by "delete_volume" :: held 3.670s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:01 devstack sudo[99205]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3aa2bf6e-2183-4439-9c38-80688f456ca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc.80887c49-27cb-4694-8bff-414f60c55821" returned: 0 in 1.189s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3aa2bf6e-2183-4439-9c38-80688f456ca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Lock "cinder-quobyte-80887c49-27cb-4694-8bff-414f60c55821" released by "_delete_snapshot" :: held 4.922s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3aa2bf6e-2183-4439-9c38-80688f456ca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Lock "cinder-quobyte-78c6fd0d-3f7d-4352-833c-b8433e75abfc" released by "delete_snapshot" :: held 4.989s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:02 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-3aa2bf6e-2183-4439-9c38-80688f456ca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Created reservations ['f84059c3-f145-4bc2-a119-3507f85e6117', '69ce87ed-af60-444d-a4c4-983b49331d98', 'b47dd81b-c6f0-442c-a8f6-04add80be85c', '56d97ded-a7ec-4b70-adba-5b7a37985e7b'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:16:02 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-3aa2bf6e-2183-4439-9c38-80688f456ca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Delete snapshot completed successfully. Jul 21 02:16:02 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3aa2bf6e-2183-4439-9c38-80688f456ca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Lock "cinder-80887c49-27cb-4694-8bff-414f60c55821-delete_snapshot" released by "delete_snapshot" :: held 5.497s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:02 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2a59f487-c836-43cc-93df-5c9973be0e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Acquiring lock "cinder-78c6fd0d-3f7d-4352-833c-b8433e75abfc-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:02 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2a59f487-c836-43cc-93df-5c9973be0e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Lock "cinder-78c6fd0d-3f7d-4352-833c-b8433e75abfc-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2a59f487-c836-43cc-93df-5c9973be0e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Acquiring lock "cinder-quobyte-78c6fd0d-3f7d-4352-833c-b8433e75abfc" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2a59f487-c836-43cc-93df-5c9973be0e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Lock "cinder-quobyte-78c6fd0d-3f7d-4352-833c-b8433e75abfc" acquired by "delete_volume" :: waited 0.074s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:03 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdf20eb-0a39-4dfd-bafc-f9088aff1b5a]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2a59f487-c836-43cc-93df-5c9973be0e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:03 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc Jul 21 02:16:03 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:04 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2a59f487-c836-43cc-93df-5c9973be0e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc" returned: 0 in 0.989s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2a59f487-c836-43cc-93df-5c9973be0e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:04 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc Jul 21 02:16:04 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:05 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1790d7c5-4bb0-4564-a02f-2b1750332755" returned: 0 in 8.385s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:05 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c462d6-907a-4ffb-816f-2e5d7468002a]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:05 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2a59f487-c836-43cc-93df-5c9973be0e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-78c6fd0d-3f7d-4352-833c-b8433e75abfc" returned: 0 in 0.834s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:05 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2a59f487-c836-43cc-93df-5c9973be0e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Lock "cinder-quobyte-78c6fd0d-3f7d-4352-833c-b8433e75abfc" released by "delete_volume" :: held 2.055s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:05 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-2a59f487-c836-43cc-93df-5c9973be0e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Created reservations ['ed99d68f-6250-437e-b14a-d1fb165ec2dd', '284eca49-1f36-4cf1-8b0c-f7017f30e6bf', '446cc4df-98c7-4940-b26a-7422338690aa', '6c3b297b-a6be-4283-83c2-abe0df14a0e2'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:16:05 devstack sudo[99225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b Jul 21 02:16:05 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2a59f487-c836-43cc-93df-5c9973be0e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2a59f487-c836-43cc-93df-5c9973be0e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2a59f487-c836-43cc-93df-5c9973be0e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:16:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2a59f487-c836-43cc-93df-5c9973be0e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:16:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2a59f487-c836-43cc-93df-5c9973be0e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2a59f487-c836-43cc-93df-5c9973be0e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:05 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:16:05 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:05 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2a59f487-c836-43cc-93df-5c9973be0e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.401s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:05 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-2a59f487-c836-43cc-93df-5c9973be0e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:16:05 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-2a59f487-c836-43cc-93df-5c9973be0e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Deleted volume successfully. Jul 21 02:16:06 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2a59f487-c836-43cc-93df-5c9973be0e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-572859431 None] Lock "cinder-78c6fd0d-3f7d-4352-833c-b8433e75abfc-delete_volume" released by "delete_volume" :: held 3.018s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:06 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b" returned: 0 in 1.141s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:06 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Image conversion details: src /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b, size 1024.00 MB, duration 8.39 sec, destination /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1790d7c5-4bb0-4564-a02f-2b1750332755 {{(pid=87566) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 02:16:06 devstack cinder-volume[87566]: INFO cinder.image.image_utils [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Converted 1024.00 MB image at 122.09 MB/s Jul 21 02:16:06 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1790d7c5-4bb0-4564-a02f-2b1750332755 is being set with open permissions: ugo+rw Jul 21 02:16:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1790d7c5-4bb0-4564-a02f-2b1750332755 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:06 devstack sudo[99233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1790d7c5-4bb0-4564-a02f-2b1750332755 Jul 21 02:16:06 devstack sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:06 devstack sudo[99233]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1790d7c5-4bb0-4564-a02f-2b1750332755" returned: 0 in 0.315s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:06 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Lock "cinder-quobyte-1790d7c5-4bb0-4564-a02f-2b1750332755" released by "_copy_volume_from_snapshot" :: held 11.291s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:06 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Lock "cinder-quobyte-6ed3d37a-1c46-45de-bef9-0eeffd11a2e7-1790d7c5-4bb0-4564-a02f-2b1750332755" released by "_create_volume_from_snapshot" :: held 11.371s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.426s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.761s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:06 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1667999407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a60349e9-d40a-45db-9c4a-7a3f1e7917a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fafd5f9ce40c480b89a8fd722e218fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:15:56Z,use_quota=True,user_id='5c45bddde11846bb8e7c689ff55f5a27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:16:06 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] Creating volume a60349e9-d40a-45db-9c4a-7a3f1e7917a6 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:16:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:06 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:16:06 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:16:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:06 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:16:06 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:16:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:06 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6 1073741824 Jul 21 02:16:06 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa9b7e32-a195-4c3a-af0e-a8361add6e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1790d7c5-4bb0-4564-a02f-2b1750332755', 'volume_size': 1, 'snapshot_id': '6ed3d37a-1c46-45de-bef9-0eeffd11a2e7'}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17f548f0-8cec-4f2f-a264-4ebdb757f1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:06 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Volume volume-1790d7c5-4bb0-4564-a02f-2b1750332755 (1790d7c5-4bb0-4564-a02f-2b1750332755): created successfully Jul 21 02:16:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17f548f0-8cec-4f2f-a264-4ebdb757f1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Flow 'volume_create_manager' (ef3276d0-19e5-432e-abf5-5d1c683cd5c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:16:06 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-7f582fb0-3d39-42f3-85da-7d1dc138eeec tempest-TestStampPattern-361473491 None] Created volume successfully. Jul 21 02:16:07 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6 1073741824" returned: 0 in 0.766s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:07 devstack sudo[99242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6 Jul 21 02:16:07 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:07 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6" returned: 0 in 0.344s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:07 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:16:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbc99a3f-89cf-4674-8766-5fda8f9a5359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea8af99b-9101-4577-914c-2023831d9400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:07 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] Volume volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6 (a60349e9-d40a-45db-9c4a-7a3f1e7917a6): created successfully Jul 21 02:16:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea8af99b-9101-4577-914c-2023831d9400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] Flow 'volume_create_manager' (6d1a8057-c7f8-49a3-83f5-63f31ee7285c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:16:07 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-e31e08ed-bf04-4658-ae18-46866ecbcda0 tempest-VolumesSnapshotTestJSON-660412331 None] Created volume successfully. Jul 21 02:16:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-31b1511d-9964-4170-8094-5f493ec8bfa8 tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-31b1511d-9964-4170-8094-5f493ec8bfa8 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:09 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-31b1511d-9964-4170-8094-5f493ec8bfa8 tempest-VolumesSnapshotTestJSON-660412331 None] Creating offline snapshot ef8004aa-ebc0-4884-bebf-dfe7be0758c6 of volume a60349e9-d40a-45db-9c4a-7a3f1e7917a6 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:16:09 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f46e80b-b382-4cf9-92c2-49c7e2c99bc1]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-31b1511d-9964-4170-8094-5f493ec8bfa8 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:09 devstack sudo[99247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6 Jul 21 02:16:09 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:09 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-31b1511d-9964-4170-8094-5f493ec8bfa8 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6" returned: 0 in 0.468s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-31b1511d-9964-4170-8094-5f493ec8bfa8 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6.ef8004aa-ebc0-4884-bebf-dfe7be0758c6 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:09 devstack sudo[99252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6.ef8004aa-ebc0-4884-bebf-dfe7be0758c6 1G Jul 21 02:16:09 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:10 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-31b1511d-9964-4170-8094-5f493ec8bfa8 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6.ef8004aa-ebc0-4884-bebf-dfe7be0758c6 1G" returned: 0 in 0.654s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-31b1511d-9964-4170-8094-5f493ec8bfa8 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6.ef8004aa-ebc0-4884-bebf-dfe7be0758c6 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:10 devstack sudo[99258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6.ef8004aa-ebc0-4884-bebf-dfe7be0758c6 Jul 21 02:16:10 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:10 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-31b1511d-9964-4170-8094-5f493ec8bfa8 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6.ef8004aa-ebc0-4884-bebf-dfe7be0758c6" returned: 0 in 0.400s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:10 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-31b1511d-9964-4170-8094-5f493ec8bfa8 tempest-VolumesSnapshotTestJSON-660412331 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6.ef8004aa-ebc0-4884-bebf-dfe7be0758c6 is being set with open permissions: ugo+rw Jul 21 02:16:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-31b1511d-9964-4170-8094-5f493ec8bfa8 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6.ef8004aa-ebc0-4884-bebf-dfe7be0758c6 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:10 devstack sudo[99263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6.ef8004aa-ebc0-4884-bebf-dfe7be0758c6 Jul 21 02:16:10 devstack sudo[99263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:10 devstack sudo[99263]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-31b1511d-9964-4170-8094-5f493ec8bfa8 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6.ef8004aa-ebc0-4884-bebf-dfe7be0758c6" returned: 0 in 0.433s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-31b1511d-9964-4170-8094-5f493ec8bfa8 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:11 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6.info Jul 21 02:16:11 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:11 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-31b1511d-9964-4170-8094-5f493ec8bfa8 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6.info" returned: 0 in 0.347s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:11 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-31b1511d-9964-4170-8094-5f493ec8bfa8 tempest-VolumesSnapshotTestJSON-660412331 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6.info is being set with open permissions: ugo+rw Jul 21 02:16:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-31b1511d-9964-4170-8094-5f493ec8bfa8 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:11 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6.info Jul 21 02:16:11 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:11 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-31b1511d-9964-4170-8094-5f493ec8bfa8 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6.info" returned: 0 in 0.308s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-31b1511d-9964-4170-8094-5f493ec8bfa8 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.791s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:11 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-31b1511d-9964-4170-8094-5f493ec8bfa8 tempest-VolumesSnapshotTestJSON-660412331 None] Create snapshot completed successfully Jul 21 02:16:12 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:16:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Flow 'volume_create_manager' (e5ab9036-6504-4261-99ec-fb98b4b51f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17fa2ed1-09c9-4aa2-a2b2-42e8c2950c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17fa2ed1-09c9-4aa2-a2b2-42e8c2950c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1099670066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=665fb015-d1f1-483b-9397-80dd7805267d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fafd5f9ce40c480b89a8fd722e218fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ef8004aa-ebc0-4884-bebf-dfe7be0758c6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:16:13Z,use_quota=True,user_id='5c45bddde11846bb8e7c689ff55f5a27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ed62d3-9f16-4db0-b862-af47778f96b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ed62d3-9f16-4db0-b862-af47778f96b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f087cd5-5ea0-4315-84bf-b19a817510f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f087cd5-5ea0-4315-84bf-b19a817510f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '665fb015-d1f1-483b-9397-80dd7805267d', 'volume_name': 'volume-665fb015-d1f1-483b-9397-80dd7805267d', 'volume_size': 1, 'snapshot_id': 'ef8004aa-ebc0-4884-bebf-dfe7be0758c6'}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f210e55-0cce-4ea5-aa13-e1371e46466d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f210e55-0cce-4ea5-aa13-e1371e46466d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1efb874-4f66-4074-93e1-ecee0b4b1d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:13 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Volume 665fb015-d1f1-483b-9397-80dd7805267d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-665fb015-d1f1-483b-9397-80dd7805267d', 'volume_size': 1, 'snapshot_id': 'ef8004aa-ebc0-4884-bebf-dfe7be0758c6'} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "cinder-quobyte-ef8004aa-ebc0-4884-bebf-dfe7be0758c6-665fb015-d1f1-483b-9397-80dd7805267d" by "_create_volume_from_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-quobyte-ef8004aa-ebc0-4884-bebf-dfe7be0758c6-665fb015-d1f1-483b-9397-80dd7805267d" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Creating volume 665fb015-d1f1-483b-9397-80dd7805267d from snapshot ef8004aa-ebc0-4884-bebf-dfe7be0758c6 {{(pid=87566) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "cinder-quobyte-665fb015-d1f1-483b-9397-80dd7805267d" by "_copy_volume_from_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-quobyte-665fb015-d1f1-483b-9397-80dd7805267d" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] snapshot: ef8004aa-ebc0-4884-bebf-dfe7be0758c6, volume: 665fb015-d1f1-483b-9397-80dd7805267d, {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f03b6b8-8bd2-4b86-9a1d-3c6eda7a25de]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6.ef8004aa-ebc0-4884-bebf-dfe7be0758c6 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:13 devstack sudo[99273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6.ef8004aa-ebc0-4884-bebf-dfe7be0758c6 Jul 21 02:16:13 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:13 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6.ef8004aa-ebc0-4884-bebf-dfe7be0758c6" returned: 0 in 0.474s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6 {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Creating direct copy from snapshot {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf29b351-dd81-4f95-9a1a-7498642e90a6]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:13 devstack sudo[99286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6 Jul 21 02:16:13 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:14 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6" returned: 0 in 0.448s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:14 devstack cinder-volume[87566]: DEBUG cinder.utils [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Path /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-665fb015-d1f1-483b-9397-80dd7805267d not found in is_blk_device check {{(pid=87566) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 02:16:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-665fb015-d1f1-483b-9397-80dd7805267d {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:14 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-665fb015-d1f1-483b-9397-80dd7805267d Jul 21 02:16:14 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:14 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:16:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] Flow 'volume_create_manager' (500b129b-07c1-495e-8937-38bf515cca11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:16:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9e7ff8-eb5b-48d1-82ea-dd6eb2aebb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9e7ff8-eb5b-48d1-82ea-dd6eb2aebb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-616571510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3e7f24e-031c-493e-abc4-0f8da51f98a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a5270fb14634d17a1b1f264023f5054',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:16:15Z,use_quota=True,user_id='cf74840f8d3f47f7913dda4e9c1d89ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb8332f-567e-461c-b8b1-64eb6e8ffff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb8332f-567e-461c-b8b1-64eb6e8ffff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e77cea42-b7a6-46d7-a900-aa4bb9c5afdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e77cea42-b7a6-46d7-a900-aa4bb9c5afdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3e7f24e-031c-493e-abc4-0f8da51f98a6', 'volume_name': 'volume-e3e7f24e-031c-493e-abc4-0f8da51f98a6', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db7ef2d8-e13b-44ca-a163-e887fc2225eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db7ef2d8-e13b-44ca-a163-e887fc2225eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2c46a7d-1caf-44d3-a5df-2ea92b8a0820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:15 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] Volume e3e7f24e-031c-493e-abc4-0f8da51f98a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3e7f24e-031c-493e-abc4-0f8da51f98a6', 'volume_size': 1} Jul 21 02:16:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:19 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-665fb015-d1f1-483b-9397-80dd7805267d" returned: 0 in 5.178s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:19 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bd26bd-aff1-4c03-92a9-6a678df1de99]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:19 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6 Jul 21 02:16:19 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:19 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6" returned: 0 in 0.560s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:19 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Image conversion details: src /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6, size 1024.00 MB, duration 5.18 sec, destination /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-665fb015-d1f1-483b-9397-80dd7805267d {{(pid=87566) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 02:16:19 devstack cinder-volume[87566]: INFO cinder.image.image_utils [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Converted 1024.00 MB image at 197.74 MB/s Jul 21 02:16:19 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-665fb015-d1f1-483b-9397-80dd7805267d is being set with open permissions: ugo+rw Jul 21 02:16:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-665fb015-d1f1-483b-9397-80dd7805267d {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:19 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-665fb015-d1f1-483b-9397-80dd7805267d Jul 21 02:16:19 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:20 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-665fb015-d1f1-483b-9397-80dd7805267d" returned: 0 in 0.273s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-quobyte-665fb015-d1f1-483b-9397-80dd7805267d" released by "_copy_volume_from_snapshot" :: held 7.060s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-quobyte-ef8004aa-ebc0-4884-bebf-dfe7be0758c6-665fb015-d1f1-483b-9397-80dd7805267d" released by "_create_volume_from_snapshot" :: held 7.105s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.138s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.197s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:20 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-616571510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3e7f24e-031c-493e-abc4-0f8da51f98a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a5270fb14634d17a1b1f264023f5054',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:16:15Z,use_quota=True,user_id='cf74840f8d3f47f7913dda4e9c1d89ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:16:20 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] Creating volume e3e7f24e-031c-493e-abc4-0f8da51f98a6 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:16:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:20 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:16:20 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:16:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:20 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:16:20 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:16:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e3e7f24e-031c-493e-abc4-0f8da51f98a6 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:20 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=104,cinder:UPDATE=78,cinder:INSERT=23,cinder:DELETE=12 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:16:20 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e3e7f24e-031c-493e-abc4-0f8da51f98a6 1073741824 Jul 21 02:16:20 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:20 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:UPDATE=100,cinder:SELECT=99,cinder:INSERT=21,cinder:DELETE=5 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:16:20 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1efb874-4f66-4074-93e1-ecee0b4b1d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-665fb015-d1f1-483b-9397-80dd7805267d', 'volume_size': 1, 'snapshot_id': 'ef8004aa-ebc0-4884-bebf-dfe7be0758c6'}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:20 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0bf48f6-1737-4944-9d77-811437ff12c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:20 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Volume volume-665fb015-d1f1-483b-9397-80dd7805267d (665fb015-d1f1-483b-9397-80dd7805267d): created successfully Jul 21 02:16:20 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0bf48f6-1737-4944-9d77-811437ff12c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:20 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Flow 'volume_create_manager' (e5ab9036-6504-4261-99ec-fb98b4b51f78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:16:20 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-c1c09ab3-16c0-44be-8bba-50bf3b6f508d tempest-VolumesSnapshotTestJSON-660412331 None] Created volume successfully. Jul 21 02:16:20 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e3e7f24e-031c-493e-abc4-0f8da51f98a6 1073741824" returned: 0 in 0.429s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e3e7f24e-031c-493e-abc4-0f8da51f98a6 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:20 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e3e7f24e-031c-493e-abc4-0f8da51f98a6 Jul 21 02:16:20 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4f754838-3590-4b4c-b194-c7b454513993 tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "cinder-665fb015-d1f1-483b-9397-80dd7805267d-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4f754838-3590-4b4c-b194-c7b454513993 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-665fb015-d1f1-483b-9397-80dd7805267d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4f754838-3590-4b4c-b194-c7b454513993 tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "cinder-quobyte-665fb015-d1f1-483b-9397-80dd7805267d" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4f754838-3590-4b4c-b194-c7b454513993 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-quobyte-665fb015-d1f1-483b-9397-80dd7805267d" acquired by "delete_volume" :: waited 0.017s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:21 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c975ee1-e830-49c6-b15b-e6f21f404bcf]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4f754838-3590-4b4c-b194-c7b454513993 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-665fb015-d1f1-483b-9397-80dd7805267d {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:21 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e3e7f24e-031c-493e-abc4-0f8da51f98a6" returned: 0 in 0.327s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:21 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:16:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:21 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2c46a7d-1caf-44d3-a5df-2ea92b8a0820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3e7f24e-031c-493e-abc4-0f8da51f98a6', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:21 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (516c77a1-c71d-4a08-8cb6-f0b6d1b1b056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:21 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] Volume volume-e3e7f24e-031c-493e-abc4-0f8da51f98a6 (e3e7f24e-031c-493e-abc4-0f8da51f98a6): created successfully Jul 21 02:16:21 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (516c77a1-c71d-4a08-8cb6-f0b6d1b1b056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:21 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] Flow 'volume_create_manager' (500b129b-07c1-495e-8937-38bf515cca11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:16:21 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-d8ac5529-b4bd-49f2-9aa6-82f91f26ea65 tempest-AbsoluteLimitsTests-1773552323 None] Created volume successfully. Jul 21 02:16:21 devstack sudo[99339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-665fb015-d1f1-483b-9397-80dd7805267d Jul 21 02:16:21 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:21 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4f754838-3590-4b4c-b194-c7b454513993 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-665fb015-d1f1-483b-9397-80dd7805267d" returned: 0 in 0.421s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4f754838-3590-4b4c-b194-c7b454513993 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-665fb015-d1f1-483b-9397-80dd7805267d {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:21 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-665fb015-d1f1-483b-9397-80dd7805267d Jul 21 02:16:21 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:21 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-40bb0638-0a2c-4a2d-946d-97fb26f7ea43 tempest-AbsoluteLimitsTests-1773552323 None] Acquiring lock "cinder-e3e7f24e-031c-493e-abc4-0f8da51f98a6-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:21 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-40bb0638-0a2c-4a2d-946d-97fb26f7ea43 tempest-AbsoluteLimitsTests-1773552323 None] Lock "cinder-e3e7f24e-031c-493e-abc4-0f8da51f98a6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:21 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-40bb0638-0a2c-4a2d-946d-97fb26f7ea43 tempest-AbsoluteLimitsTests-1773552323 None] Acquiring lock "cinder-quobyte-e3e7f24e-031c-493e-abc4-0f8da51f98a6" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:21 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-40bb0638-0a2c-4a2d-946d-97fb26f7ea43 tempest-AbsoluteLimitsTests-1773552323 None] Lock "cinder-quobyte-e3e7f24e-031c-493e-abc4-0f8da51f98a6" acquired by "delete_volume" :: waited 0.023s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:21 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e828a6-32d4-4c30-8b09-ce954dff5cc6]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-40bb0638-0a2c-4a2d-946d-97fb26f7ea43 tempest-AbsoluteLimitsTests-1773552323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e3e7f24e-031c-493e-abc4-0f8da51f98a6 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:21 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4f754838-3590-4b4c-b194-c7b454513993 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-665fb015-d1f1-483b-9397-80dd7805267d" returned: 0 in 0.293s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:21 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4f754838-3590-4b4c-b194-c7b454513993 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-quobyte-665fb015-d1f1-483b-9397-80dd7805267d" released by "delete_volume" :: held 0.768s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:21 devstack sudo[99347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e3e7f24e-031c-493e-abc4-0f8da51f98a6 Jul 21 02:16:21 devstack sudo[99347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:21 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-4f754838-3590-4b4c-b194-c7b454513993 tempest-VolumesSnapshotTestJSON-660412331 None] Created reservations ['a153b229-d864-4be4-b732-e6f096a7144a', '3b13ce4b-f5c1-42f1-9362-b81da5459979', '7337b1a3-2842-4ce0-92a8-709a417ffee9', '6928a2ef-f8a9-4b54-b038-a35320348d63'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:16:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4f754838-3590-4b4c-b194-c7b454513993 tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4f754838-3590-4b4c-b194-c7b454513993 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:21 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4f754838-3590-4b4c-b194-c7b454513993 tempest-VolumesSnapshotTestJSON-660412331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:16:21 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4f754838-3590-4b4c-b194-c7b454513993 tempest-VolumesSnapshotTestJSON-660412331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:16:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4f754838-3590-4b4c-b194-c7b454513993 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4f754838-3590-4b4c-b194-c7b454513993 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:21 devstack sudo[99350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:16:21 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:22 devstack sudo[99347]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-40bb0638-0a2c-4a2d-946d-97fb26f7ea43 tempest-AbsoluteLimitsTests-1773552323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e3e7f24e-031c-493e-abc4-0f8da51f98a6" returned: 0 in 0.472s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-40bb0638-0a2c-4a2d-946d-97fb26f7ea43 tempest-AbsoluteLimitsTests-1773552323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e3e7f24e-031c-493e-abc4-0f8da51f98a6 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:22 devstack sudo[99355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e3e7f24e-031c-493e-abc4-0f8da51f98a6 Jul 21 02:16:22 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3b457506-dcce-4219-8f1e-1f6d5e673ef3 tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "cinder-ef8004aa-ebc0-4884-bebf-dfe7be0758c6-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3b457506-dcce-4219-8f1e-1f6d5e673ef3 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-ef8004aa-ebc0-4884-bebf-dfe7be0758c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3b457506-dcce-4219-8f1e-1f6d5e673ef3 tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "cinder-quobyte-a60349e9-d40a-45db-9c4a-7a3f1e7917a6" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:22 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4f754838-3590-4b4c-b194-c7b454513993 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.355s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:22 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-4f754838-3590-4b4c-b194-c7b454513993 tempest-VolumesSnapshotTestJSON-660412331 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:16:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3b457506-dcce-4219-8f1e-1f6d5e673ef3 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-quobyte-a60349e9-d40a-45db-9c4a-7a3f1e7917a6" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3b457506-dcce-4219-8f1e-1f6d5e673ef3 tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "cinder-quobyte-ef8004aa-ebc0-4884-bebf-dfe7be0758c6" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:22 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-4f754838-3590-4b4c-b194-c7b454513993 tempest-VolumesSnapshotTestJSON-660412331 None] Deleted volume successfully. Jul 21 02:16:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3b457506-dcce-4219-8f1e-1f6d5e673ef3 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-quobyte-ef8004aa-ebc0-4884-bebf-dfe7be0758c6" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:22 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-3b457506-dcce-4219-8f1e-1f6d5e673ef3 tempest-VolumesSnapshotTestJSON-660412331 None] Deleting offline snapshot ef8004aa-ebc0-4884-bebf-dfe7be0758c6 of volume a60349e9-d40a-45db-9c4a-7a3f1e7917a6 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:16:22 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-3b457506-dcce-4219-8f1e-1f6d5e673ef3 tempest-VolumesSnapshotTestJSON-660412331 None] snapshot_file for this snap is: volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6.ef8004aa-ebc0-4884-bebf-dfe7be0758c6 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:16:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4f754838-3590-4b4c-b194-c7b454513993 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-665fb015-d1f1-483b-9397-80dd7805267d-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:22 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23881bb-b13d-4c40-a132-c1538941e858]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3b457506-dcce-4219-8f1e-1f6d5e673ef3 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6.ef8004aa-ebc0-4884-bebf-dfe7be0758c6 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:22 devstack sudo[99358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6.ef8004aa-ebc0-4884-bebf-dfe7be0758c6 Jul 21 02:16:22 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:22 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-40bb0638-0a2c-4a2d-946d-97fb26f7ea43 tempest-AbsoluteLimitsTests-1773552323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e3e7f24e-031c-493e-abc4-0f8da51f98a6" returned: 0 in 0.331s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-40bb0638-0a2c-4a2d-946d-97fb26f7ea43 tempest-AbsoluteLimitsTests-1773552323 None] Lock "cinder-quobyte-e3e7f24e-031c-493e-abc4-0f8da51f98a6" released by "delete_volume" :: held 0.863s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:22 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-40bb0638-0a2c-4a2d-946d-97fb26f7ea43 tempest-AbsoluteLimitsTests-1773552323 None] Created reservations ['1ffe571f-3cc7-48fe-8349-d07257fa709a', '90ab60f7-26ad-47ca-9eda-838d23b659c2', 'aea726e1-eb8f-4557-b733-c491db3f85b1', '9595a2d1-d0b9-4106-8117-671792579244'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:16:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-40bb0638-0a2c-4a2d-946d-97fb26f7ea43 tempest-AbsoluteLimitsTests-1773552323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-40bb0638-0a2c-4a2d-946d-97fb26f7ea43 tempest-AbsoluteLimitsTests-1773552323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:22 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-40bb0638-0a2c-4a2d-946d-97fb26f7ea43 tempest-AbsoluteLimitsTests-1773552323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:16:22 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-40bb0638-0a2c-4a2d-946d-97fb26f7ea43 tempest-AbsoluteLimitsTests-1773552323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:16:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-40bb0638-0a2c-4a2d-946d-97fb26f7ea43 tempest-AbsoluteLimitsTests-1773552323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-40bb0638-0a2c-4a2d-946d-97fb26f7ea43 tempest-AbsoluteLimitsTests-1773552323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:22 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:16:22 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:22 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3b457506-dcce-4219-8f1e-1f6d5e673ef3 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6.ef8004aa-ebc0-4884-bebf-dfe7be0758c6" returned: 0 in 0.437s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:22 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-3b457506-dcce-4219-8f1e-1f6d5e673ef3 tempest-VolumesSnapshotTestJSON-660412331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:16:22 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b90f759-62d9-43ef-a8cd-3c3fa351e2d4]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3b457506-dcce-4219-8f1e-1f6d5e673ef3 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:22 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-40bb0638-0a2c-4a2d-946d-97fb26f7ea43 tempest-AbsoluteLimitsTests-1773552323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.274s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:22 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-40bb0638-0a2c-4a2d-946d-97fb26f7ea43 tempest-AbsoluteLimitsTests-1773552323 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:16:22 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-40bb0638-0a2c-4a2d-946d-97fb26f7ea43 tempest-AbsoluteLimitsTests-1773552323 None] Deleted volume successfully. Jul 21 02:16:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-40bb0638-0a2c-4a2d-946d-97fb26f7ea43 tempest-AbsoluteLimitsTests-1773552323 None] Lock "cinder-e3e7f24e-031c-493e-abc4-0f8da51f98a6-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:22 devstack sudo[99368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6 Jul 21 02:16:22 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:23 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:16:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] Flow 'volume_create_manager' (f3c0f3cd-c193-4cfd-97ff-8d39f10477e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:16:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36171f47-570c-47e7-af84-0ae8f1ec4538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36171f47-570c-47e7-af84-0ae8f1ec4538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1654301415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dcb15f4-0e19-45cc-89fa-892b729b5c2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee9a5e5a66f4d6f9570fc3622d7d0ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:16:23Z,use_quota=True,user_id='3214e5ee85e54b4584ea4413f04ea683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:23 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df5d4e3e-db19-4c30-b0b3-640d9c6d6fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df5d4e3e-db19-4c30-b0b3-640d9c6d6fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738e3a31-3973-4d6e-b8a6-509106203ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738e3a31-3973-4d6e-b8a6-509106203ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dcb15f4-0e19-45cc-89fa-892b729b5c2f', 'volume_name': 'volume-6dcb15f4-0e19-45cc-89fa-892b729b5c2f', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d41420bc-1840-42dd-a97b-801ae463972d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d41420bc-1840-42dd-a97b-801ae463972d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99340547-be2a-46f5-a04d-bf18bc56ebc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:23 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] Volume 6dcb15f4-0e19-45cc-89fa-892b729b5c2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dcb15f4-0e19-45cc-89fa-892b729b5c2f', 'volume_size': 1} Jul 21 02:16:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:23 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1654301415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dcb15f4-0e19-45cc-89fa-892b729b5c2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee9a5e5a66f4d6f9570fc3622d7d0ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:16:23Z,use_quota=True,user_id='3214e5ee85e54b4584ea4413f04ea683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:16:23 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] Creating volume 6dcb15f4-0e19-45cc-89fa-892b729b5c2f {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:16:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:23 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:16:23 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:16:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:23 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:16:23 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:16:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6dcb15f4-0e19-45cc-89fa-892b729b5c2f 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3b457506-dcce-4219-8f1e-1f6d5e673ef3 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6" returned: 0 in 0.515s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3b457506-dcce-4219-8f1e-1f6d5e673ef3 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6.ef8004aa-ebc0-4884-bebf-dfe7be0758c6 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:23 devstack sudo[99374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6dcb15f4-0e19-45cc-89fa-892b729b5c2f 1073741824 Jul 21 02:16:23 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:23 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6.ef8004aa-ebc0-4884-bebf-dfe7be0758c6 Jul 21 02:16:23 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:23 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3b457506-dcce-4219-8f1e-1f6d5e673ef3 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6.ef8004aa-ebc0-4884-bebf-dfe7be0758c6" returned: 0 in 0.359s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3b457506-dcce-4219-8f1e-1f6d5e673ef3 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6.ef8004aa-ebc0-4884-bebf-dfe7be0758c6 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:23 devstack sudo[99386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6.ef8004aa-ebc0-4884-bebf-dfe7be0758c6 Jul 21 02:16:23 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:23 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6dcb15f4-0e19-45cc-89fa-892b729b5c2f 1073741824" returned: 0 in 0.500s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6dcb15f4-0e19-45cc-89fa-892b729b5c2f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:23 devstack sudo[99388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6dcb15f4-0e19-45cc-89fa-892b729b5c2f Jul 21 02:16:23 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:23 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3b457506-dcce-4219-8f1e-1f6d5e673ef3 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6.ef8004aa-ebc0-4884-bebf-dfe7be0758c6" returned: 0 in 0.276s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:24 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3b457506-dcce-4219-8f1e-1f6d5e673ef3 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-quobyte-ef8004aa-ebc0-4884-bebf-dfe7be0758c6" released by "_delete_snapshot" :: held 1.732s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:24 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3b457506-dcce-4219-8f1e-1f6d5e673ef3 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-quobyte-a60349e9-d40a-45db-9c4a-7a3f1e7917a6" released by "delete_snapshot" :: held 1.770s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:24 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-3b457506-dcce-4219-8f1e-1f6d5e673ef3 tempest-VolumesSnapshotTestJSON-660412331 None] Created reservations ['bfca8ce8-0402-4d91-94f0-b39fa2000aea', '3b15cc4c-2092-476b-ba12-c19ef4dc815d', 'a2a76572-f880-4c66-b4b4-203ae34351d0', '04dc13d1-3d6d-4de7-8329-76d832ee9147'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:16:24 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6dcb15f4-0e19-45cc-89fa-892b729b5c2f" returned: 0 in 0.282s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:24 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:16:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:24 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99340547-be2a-46f5-a04d-bf18bc56ebc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dcb15f4-0e19-45cc-89fa-892b729b5c2f', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:24 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a026048-2752-405e-98f8-e33c72d53cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:24 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] Volume volume-6dcb15f4-0e19-45cc-89fa-892b729b5c2f (6dcb15f4-0e19-45cc-89fa-892b729b5c2f): created successfully Jul 21 02:16:24 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a026048-2752-405e-98f8-e33c72d53cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:24 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] Flow 'volume_create_manager' (f3c0f3cd-c193-4cfd-97ff-8d39f10477e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:16:24 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-3b457506-dcce-4219-8f1e-1f6d5e673ef3 tempest-VolumesSnapshotTestJSON-660412331 None] Delete snapshot completed successfully. Jul 21 02:16:24 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-1ff18bd6-b44e-482d-bd16-2901732282e1 tempest-VolumesListAdminTestJSON-512470297 None] Created volume successfully. Jul 21 02:16:24 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3b457506-dcce-4219-8f1e-1f6d5e673ef3 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-ef8004aa-ebc0-4884-bebf-dfe7be0758c6-delete_snapshot" released by "delete_snapshot" :: held 1.986s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:24 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9b9bb603-d581-4662-8613-ee3ea8153d68 tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "cinder-a60349e9-d40a-45db-9c4a-7a3f1e7917a6-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:24 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9b9bb603-d581-4662-8613-ee3ea8153d68 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-a60349e9-d40a-45db-9c4a-7a3f1e7917a6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:24 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9b9bb603-d581-4662-8613-ee3ea8153d68 tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "cinder-quobyte-a60349e9-d40a-45db-9c4a-7a3f1e7917a6" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:24 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9b9bb603-d581-4662-8613-ee3ea8153d68 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-quobyte-a60349e9-d40a-45db-9c4a-7a3f1e7917a6" acquired by "delete_volume" :: waited 0.017s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:24 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a432937-de3e-424e-9e0c-afb7a12c9ade]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9b9bb603-d581-4662-8613-ee3ea8153d68 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:24 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6 Jul 21 02:16:24 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:24 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9b9bb603-d581-4662-8613-ee3ea8153d68 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6" returned: 0 in 0.386s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9b9bb603-d581-4662-8613-ee3ea8153d68 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:24 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6 Jul 21 02:16:24 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:25 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9b9bb603-d581-4662-8613-ee3ea8153d68 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a60349e9-d40a-45db-9c4a-7a3f1e7917a6" returned: 0 in 0.312s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:25 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9b9bb603-d581-4662-8613-ee3ea8153d68 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-quobyte-a60349e9-d40a-45db-9c4a-7a3f1e7917a6" released by "delete_volume" :: held 0.764s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:25 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-9b9bb603-d581-4662-8613-ee3ea8153d68 tempest-VolumesSnapshotTestJSON-660412331 None] Created reservations ['ce1807c3-0daa-49af-80af-a8e9bc0aeec0', '21343b8d-6563-4771-9569-dfbe20d8c082', 'ae82c344-bdf3-47f9-a2d8-34038f7b99f8', '51a57b09-c101-4a10-b186-20eed23a0e4f'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:16:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9b9bb603-d581-4662-8613-ee3ea8153d68 tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9b9bb603-d581-4662-8613-ee3ea8153d68 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:25 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9b9bb603-d581-4662-8613-ee3ea8153d68 tempest-VolumesSnapshotTestJSON-660412331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:16:25 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9b9bb603-d581-4662-8613-ee3ea8153d68 tempest-VolumesSnapshotTestJSON-660412331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:16:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9b9bb603-d581-4662-8613-ee3ea8153d68 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9b9bb603-d581-4662-8613-ee3ea8153d68 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:25 devstack sudo[99400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:16:25 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:25 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:25 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-641a772c-5ba8-498e-80b9-74360cf5cb06 tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "cinder-3e79964e-f81e-4773-bcb6-9712ab0ed2b0-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9b9bb603-d581-4662-8613-ee3ea8153d68 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.346s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:25 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-9b9bb603-d581-4662-8613-ee3ea8153d68 tempest-VolumesSnapshotTestJSON-660412331 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:16:25 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-9b9bb603-d581-4662-8613-ee3ea8153d68 tempest-VolumesSnapshotTestJSON-660412331 None] Deleted volume successfully. Jul 21 02:16:25 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-641a772c-5ba8-498e-80b9-74360cf5cb06 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-3e79964e-f81e-4773-bcb6-9712ab0ed2b0-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:25 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9b9bb603-d581-4662-8613-ee3ea8153d68 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-a60349e9-d40a-45db-9c4a-7a3f1e7917a6-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:25 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-641a772c-5ba8-498e-80b9-74360cf5cb06 tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "cinder-quobyte-3e79964e-f81e-4773-bcb6-9712ab0ed2b0" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:25 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-641a772c-5ba8-498e-80b9-74360cf5cb06 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-quobyte-3e79964e-f81e-4773-bcb6-9712ab0ed2b0" acquired by "delete_volume" :: waited 0.033s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:25 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cd0316-7040-4bbb-89ce-8b2fee519ff6]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-641a772c-5ba8-498e-80b9-74360cf5cb06 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] Flow 'volume_create_manager' (928e8fc8-b987-420f-a2a0-c6f670495f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caea0a3b-624b-4e5e-8763-3e7987f051e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:26 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0 Jul 21 02:16:26 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caea0a3b-624b-4e5e-8763-3e7987f051e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-27484898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59855606-a0b0-45cd-980a-688ff0b54914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee9a5e5a66f4d6f9570fc3622d7d0ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:16:26Z,use_quota=True,user_id='3214e5ee85e54b4584ea4413f04ea683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c38b07-5602-4b64-ae84-58b31a0a3caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c38b07-5602-4b64-ae84-58b31a0a3caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb3b516a-8a1a-4be4-a498-6312f7231cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb3b516a-8a1a-4be4-a498-6312f7231cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59855606-a0b0-45cd-980a-688ff0b54914', 'volume_name': 'volume-59855606-a0b0-45cd-980a-688ff0b54914', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8994038e-2950-4048-8d8d-d60fe89e0061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8994038e-2950-4048-8d8d-d60fe89e0061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55419a5c-3f2a-475b-8115-36e276e8effa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:26 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] Volume 59855606-a0b0-45cd-980a-688ff0b54914: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59855606-a0b0-45cd-980a-688ff0b54914', 'volume_size': 1} Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-27484898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59855606-a0b0-45cd-980a-688ff0b54914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee9a5e5a66f4d6f9570fc3622d7d0ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:16:26Z,use_quota=True,user_id='3214e5ee85e54b4584ea4413f04ea683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] Creating volume 59855606-a0b0-45cd-980a-688ff0b54914 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:16:26 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-59855606-a0b0-45cd-980a-688ff0b54914 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:26 devstack sudo[99405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-59855606-a0b0-45cd-980a-688ff0b54914 1073741824 Jul 21 02:16:26 devstack sudo[99405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:26 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-641a772c-5ba8-498e-80b9-74360cf5cb06 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0" returned: 0 in 0.474s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-641a772c-5ba8-498e-80b9-74360cf5cb06 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:26 devstack sudo[99413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0 Jul 21 02:16:26 devstack sudo[99413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:26 devstack sudo[99405]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-59855606-a0b0-45cd-980a-688ff0b54914 1073741824" returned: 0 in 0.535s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-59855606-a0b0-45cd-980a-688ff0b54914 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:26 devstack sudo[99413]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-641a772c-5ba8-498e-80b9-74360cf5cb06 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3e79964e-f81e-4773-bcb6-9712ab0ed2b0" returned: 0 in 0.325s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:26 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-59855606-a0b0-45cd-980a-688ff0b54914 Jul 21 02:16:26 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-641a772c-5ba8-498e-80b9-74360cf5cb06 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-quobyte-3e79964e-f81e-4773-bcb6-9712ab0ed2b0" released by "delete_volume" :: held 0.894s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-641a772c-5ba8-498e-80b9-74360cf5cb06 tempest-VolumesSnapshotTestJSON-660412331 None] Created reservations ['edb450c8-9442-46eb-a85f-4686ab235814', '5316b1f0-a5e2-4588-b4b8-e53aa459a145', 'dad70acc-af63-4fc4-a140-437d647f2d65', '78cfb98a-741c-4659-838d-c2358ef48472'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-641a772c-5ba8-498e-80b9-74360cf5cb06 tempest-VolumesSnapshotTestJSON-660412331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-641a772c-5ba8-498e-80b9-74360cf5cb06 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-641a772c-5ba8-498e-80b9-74360cf5cb06 tempest-VolumesSnapshotTestJSON-660412331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-641a772c-5ba8-498e-80b9-74360cf5cb06 tempest-VolumesSnapshotTestJSON-660412331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-641a772c-5ba8-498e-80b9-74360cf5cb06 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-641a772c-5ba8-498e-80b9-74360cf5cb06 tempest-VolumesSnapshotTestJSON-660412331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:26 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:16:26 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:27 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-59855606-a0b0-45cd-980a-688ff0b54914" returned: 0 in 0.378s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:27 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:16:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:27 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55419a5c-3f2a-475b-8115-36e276e8effa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59855606-a0b0-45cd-980a-688ff0b54914', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:27 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c828e8e-1ab8-4f19-8e6d-6d70fe419359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:27 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] Volume volume-59855606-a0b0-45cd-980a-688ff0b54914 (59855606-a0b0-45cd-980a-688ff0b54914): created successfully Jul 21 02:16:27 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c828e8e-1ab8-4f19-8e6d-6d70fe419359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:27 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] Flow 'volume_create_manager' (928e8fc8-b987-420f-a2a0-c6f670495f91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:16:27 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-3053dcc2-9b5c-45f5-b04c-ea5a1c286a67 tempest-VolumesListAdminTestJSON-512470297 None] Created volume successfully. Jul 21 02:16:27 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-641a772c-5ba8-498e-80b9-74360cf5cb06 tempest-VolumesSnapshotTestJSON-660412331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.438s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:27 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-641a772c-5ba8-498e-80b9-74360cf5cb06 tempest-VolumesSnapshotTestJSON-660412331 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:16:27 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-641a772c-5ba8-498e-80b9-74360cf5cb06 tempest-VolumesSnapshotTestJSON-660412331 None] Deleted volume successfully. Jul 21 02:16:27 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-641a772c-5ba8-498e-80b9-74360cf5cb06 tempest-VolumesSnapshotTestJSON-660412331 None] Lock "cinder-3e79964e-f81e-4773-bcb6-9712ab0ed2b0-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:27 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:16:27 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] Flow 'volume_create_manager' (12d831ea-c12b-4ba1-8679-03acf855cd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:16:27 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2bf892b-7372-484d-8278-ac049906fe87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:27 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2bf892b-7372-484d-8278-ac049906fe87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1287675086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=681a1adb-5694-4447-9aef-d55b2da11b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a800b1e9dd5841c58107782f5ccafe8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:16:28Z,use_quota=True,user_id='7a26c6494e634984a1386ed89006ec4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:27 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (013d30a2-4389-43f4-9ce6-f70a5c7d1af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:27 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (013d30a2-4389-43f4-9ce6-f70a5c7d1af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:27 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50aaf500-3f66-4d28-ba45-f638527f9af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:27 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50aaf500-3f66-4d28-ba45-f638527f9af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '681a1adb-5694-4447-9aef-d55b2da11b98', 'volume_name': 'volume-681a1adb-5694-4447-9aef-d55b2da11b98', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:27 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ed1f06-2102-444a-b9eb-46e4b037053f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:27 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ed1f06-2102-444a-b9eb-46e4b037053f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:27 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (410d4397-c8a1-4d89-90cd-91ccac57f103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:27 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] Volume 681a1adb-5694-4447-9aef-d55b2da11b98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-681a1adb-5694-4447-9aef-d55b2da11b98', 'volume_size': 1} Jul 21 02:16:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:27 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1287675086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=681a1adb-5694-4447-9aef-d55b2da11b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a800b1e9dd5841c58107782f5ccafe8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:16:28Z,use_quota=True,user_id='7a26c6494e634984a1386ed89006ec4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:16:27 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] Creating volume 681a1adb-5694-4447-9aef-d55b2da11b98 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:16:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:27 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:16:27 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:16:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:27 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:16:27 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:16:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:27 devstack sudo[99424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98 1073741824 Jul 21 02:16:27 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:28 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98 1073741824" returned: 0 in 0.604s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:28 devstack sudo[99433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98 Jul 21 02:16:28 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:28 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98" returned: 0 in 0.361s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:28 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:16:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:28 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (410d4397-c8a1-4d89-90cd-91ccac57f103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-681a1adb-5694-4447-9aef-d55b2da11b98', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:28 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c94964d-da29-46da-9d75-30951b37ddb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:28 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] Volume volume-681a1adb-5694-4447-9aef-d55b2da11b98 (681a1adb-5694-4447-9aef-d55b2da11b98): created successfully Jul 21 02:16:28 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c94964d-da29-46da-9d75-30951b37ddb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:28 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] Flow 'volume_create_manager' (12d831ea-c12b-4ba1-8679-03acf855cd96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:16:28 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-f79c050e-e6d6-4458-b8b8-30321185a688 tempest-VolumesDeleteCascade-1628845007 None] Created volume successfully. Jul 21 02:16:28 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:16:28 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] Flow 'volume_create_manager' (4657d4fb-0076-4a8c-a3bb-4b2d2976616a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:16:28 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6ad2d62-4ed1-4c9e-ae20-acd931647ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:28 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6ad2d62-4ed1-4c9e-ae20-acd931647ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-635107192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64b8849f-cd5e-448a-b71d-0d8b361f02ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee9a5e5a66f4d6f9570fc3622d7d0ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:16:29Z,use_quota=True,user_id='3214e5ee85e54b4584ea4413f04ea683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:28 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cd5e674-684c-4b84-84d2-66d701b959cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:28 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cd5e674-684c-4b84-84d2-66d701b959cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:28 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46fbc8c6-ac7c-42ad-bf5c-60a98023f9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:28 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46fbc8c6-ac7c-42ad-bf5c-60a98023f9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64b8849f-cd5e-448a-b71d-0d8b361f02ba', 'volume_name': 'volume-64b8849f-cd5e-448a-b71d-0d8b361f02ba', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:28 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0175cf-f6d8-4b3b-bad6-24a093ed0191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:28 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0175cf-f6d8-4b3b-bad6-24a093ed0191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:28 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d04f9ed4-639b-4e25-aabb-45ff7412cb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:28 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] Volume 64b8849f-cd5e-448a-b71d-0d8b361f02ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64b8849f-cd5e-448a-b71d-0d8b361f02ba', 'volume_size': 1} Jul 21 02:16:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:28 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-635107192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64b8849f-cd5e-448a-b71d-0d8b361f02ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee9a5e5a66f4d6f9570fc3622d7d0ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:16:29Z,use_quota=True,user_id='3214e5ee85e54b4584ea4413f04ea683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:16:28 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] Creating volume 64b8849f-cd5e-448a-b71d-0d8b361f02ba {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:16:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:28 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:16:28 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:16:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:28 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:16:28 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:16:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b8849f-cd5e-448a-b71d-0d8b361f02ba 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:28 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b8849f-cd5e-448a-b71d-0d8b361f02ba 1073741824 Jul 21 02:16:28 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-6ecf7718-f382-424b-8c67-7b5946b4cd19 req-50b92bb6-2129-478c-b0df-f37e805f7996 tempest-TestStampPattern-361473491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:29 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b8849f-cd5e-448a-b71d-0d8b361f02ba 1073741824" returned: 0 in 0.520s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b8849f-cd5e-448a-b71d-0d8b361f02ba {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:29 devstack sudo[99455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b8849f-cd5e-448a-b71d-0d8b361f02ba Jul 21 02:16:29 devstack sudo[99455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:29 devstack sudo[99455]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b8849f-cd5e-448a-b71d-0d8b361f02ba" returned: 0 in 0.295s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:29 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:16:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-6ecf7718-f382-424b-8c67-7b5946b4cd19 req-50b92bb6-2129-478c-b0df-f37e805f7996 tempest-TestStampPattern-361473491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.381s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:29 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d04f9ed4-639b-4e25-aabb-45ff7412cb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64b8849f-cd5e-448a-b71d-0d8b361f02ba', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:29 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56209777-ea8b-471d-801f-d21f0f5fbe53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:29 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] Volume volume-64b8849f-cd5e-448a-b71d-0d8b361f02ba (64b8849f-cd5e-448a-b71d-0d8b361f02ba): created successfully Jul 21 02:16:29 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56209777-ea8b-471d-801f-d21f0f5fbe53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:29 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] Flow 'volume_create_manager' (4657d4fb-0076-4a8c-a3bb-4b2d2976616a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:16:29 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-8f88b393-bf8f-44d0-880f-8af00af8f8ce tempest-VolumesListAdminTestJSON-512470297 None] Created volume successfully. Jul 21 02:16:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d61819d2-951b-498e-8872-f3e51cbc4303 tempest-VolumesDeleteCascade-1628845007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:29 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6f031a-3fd9-41b2-8551-9dd247c0ea16]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-6ecf7718-f382-424b-8c67-7b5946b4cd19 req-50b92bb6-2129-478c-b0df-f37e805f7996 tempest-TestStampPattern-361473491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1790d7c5-4bb0-4564-a02f-2b1750332755 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:30 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1790d7c5-4bb0-4564-a02f-2b1750332755 Jul 21 02:16:30 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:30 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-6ecf7718-f382-424b-8c67-7b5946b4cd19 req-50b92bb6-2129-478c-b0df-f37e805f7996 tempest-TestStampPattern-361473491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1790d7c5-4bb0-4564-a02f-2b1750332755" returned: 0 in 0.409s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-6ecf7718-f382-424b-8c67-7b5946b4cd19 req-50b92bb6-2129-478c-b0df-f37e805f7996 tempest-TestStampPattern-361473491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.532s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d61819d2-951b-498e-8872-f3e51cbc4303 tempest-VolumesDeleteCascade-1628845007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.419s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:30 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-d61819d2-951b-498e-8872-f3e51cbc4303 tempest-VolumesDeleteCascade-1628845007 None] Creating offline snapshot 4dade052-1253-4cbf-9220-7dcbbbfe0664 of volume 681a1adb-5694-4447-9aef-d55b2da11b98 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:16:30 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcec3be7-ec0c-4487-9121-e84ec64635f2]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d61819d2-951b-498e-8872-f3e51cbc4303 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-6ecf7718-f382-424b-8c67-7b5946b4cd19 req-50b92bb6-2129-478c-b0df-f37e805f7996 tempest-TestStampPattern-361473491 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea', 'name': 'volume-1790d7c5-4bb0-4564-a02f-2b1750332755', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '70f053f5-4e2a-4fdd-bebc-254f47b98090', 'enforce_multipath': True} {{(pid=87566) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 02:16:30 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-6ecf7718-f382-424b-8c67-7b5946b4cd19 req-50b92bb6-2129-478c-b0df-f37e805f7996 tempest-TestStampPattern-361473491 None] attachment_update completed successfully. Jul 21 02:16:30 devstack sudo[99464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98 Jul 21 02:16:30 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:30 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d61819d2-951b-498e-8872-f3e51cbc4303 tempest-VolumesDeleteCascade-1628845007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98" returned: 0 in 0.434s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d61819d2-951b-498e-8872-f3e51cbc4303 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.4dade052-1253-4cbf-9220-7dcbbbfe0664 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:30 devstack sudo[99849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.4dade052-1253-4cbf-9220-7dcbbbfe0664 1G Jul 21 02:16:30 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:31 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d61819d2-951b-498e-8872-f3e51cbc4303 tempest-VolumesDeleteCascade-1628845007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.4dade052-1253-4cbf-9220-7dcbbbfe0664 1G" returned: 0 in 0.610s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d61819d2-951b-498e-8872-f3e51cbc4303 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-681a1adb-5694-4447-9aef-d55b2da11b98 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.4dade052-1253-4cbf-9220-7dcbbbfe0664 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:31 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-681a1adb-5694-4447-9aef-d55b2da11b98 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.4dade052-1253-4cbf-9220-7dcbbbfe0664 Jul 21 02:16:31 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:31 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d61819d2-951b-498e-8872-f3e51cbc4303 tempest-VolumesDeleteCascade-1628845007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-681a1adb-5694-4447-9aef-d55b2da11b98 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.4dade052-1253-4cbf-9220-7dcbbbfe0664" returned: 0 in 0.369s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:31 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-d61819d2-951b-498e-8872-f3e51cbc4303 tempest-VolumesDeleteCascade-1628845007 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.4dade052-1253-4cbf-9220-7dcbbbfe0664 is being set with open permissions: ugo+rw Jul 21 02:16:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d61819d2-951b-498e-8872-f3e51cbc4303 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.4dade052-1253-4cbf-9220-7dcbbbfe0664 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:31 devstack sudo[99864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.4dade052-1253-4cbf-9220-7dcbbbfe0664 Jul 21 02:16:31 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:32 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:16:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] Flow 'volume_create_manager' (85911aff-13b9-4cb8-8cdf-71a2809ea210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:16:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12cd0ca5-49b5-4b46-8423-d9ecca96526c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:32 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12cd0ca5-49b5-4b46-8423-d9ecca96526c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca5f1d20-be5f-4c75-ae4f-27bf11e74be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6dd3d6fbf674d2b91cc7bac026bde55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:16:32Z,use_quota=True,user_id='0cf3c02eefa247bcb3fef74dc84b15d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac9b5fe3-cc1c-41cc-b249-db1f4d23017c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac9b5fe3-cc1c-41cc-b249-db1f4d23017c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26316000-a88d-4327-b389-86982e1ec1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26316000-a88d-4327-b389-86982e1ec1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca5f1d20-be5f-4c75-ae4f-27bf11e74be7', 'volume_name': 'volume-ca5f1d20-be5f-4c75-ae4f-27bf11e74be7', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9264c16b-cacf-4da2-9b9b-72fc2d7e8b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9264c16b-cacf-4da2-9b9b-72fc2d7e8b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9b2de2-b774-4ce8-8375-22edbfc78337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:32 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] Volume ca5f1d20-be5f-4c75-ae4f-27bf11e74be7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca5f1d20-be5f-4c75-ae4f-27bf11e74be7', 'volume_size': 1} Jul 21 02:16:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d61819d2-951b-498e-8872-f3e51cbc4303 tempest-VolumesDeleteCascade-1628845007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.4dade052-1253-4cbf-9220-7dcbbbfe0664" returned: 0 in 0.344s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d61819d2-951b-498e-8872-f3e51cbc4303 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:32 devstack sudo[99867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.info Jul 21 02:16:32 devstack sudo[99867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:32 devstack sudo[99867]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d61819d2-951b-498e-8872-f3e51cbc4303 tempest-VolumesDeleteCascade-1628845007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.info" returned: 0 in 0.259s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:32 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-d61819d2-951b-498e-8872-f3e51cbc4303 tempest-VolumesDeleteCascade-1628845007 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.info is being set with open permissions: ugo+rw Jul 21 02:16:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d61819d2-951b-498e-8872-f3e51cbc4303 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:32 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.info Jul 21 02:16:32 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:32 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d61819d2-951b-498e-8872-f3e51cbc4303 tempest-VolumesDeleteCascade-1628845007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.info" returned: 0 in 0.268s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d61819d2-951b-498e-8872-f3e51cbc4303 tempest-VolumesDeleteCascade-1628845007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.378s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.580s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:32 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca5f1d20-be5f-4c75-ae4f-27bf11e74be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6dd3d6fbf674d2b91cc7bac026bde55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:16:32Z,use_quota=True,user_id='0cf3c02eefa247bcb3fef74dc84b15d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:16:32 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] Creating volume ca5f1d20-be5f-4c75-ae4f-27bf11e74be7 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:16:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:32 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:16:32 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:16:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:32 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:16:32 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:16:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ca5f1d20-be5f-4c75-ae4f-27bf11e74be7 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:32 devstack sudo[99880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ca5f1d20-be5f-4c75-ae4f-27bf11e74be7 1073741824 Jul 21 02:16:32 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:32 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-d61819d2-951b-498e-8872-f3e51cbc4303 tempest-VolumesDeleteCascade-1628845007 None] Create snapshot completed successfully Jul 21 02:16:33 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ca5f1d20-be5f-4c75-ae4f-27bf11e74be7 1073741824" returned: 0 in 0.601s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-52ab126a-266e-400c-8b33-fc7dcf043262 tempest-VolumesDeleteCascade-1628845007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ca5f1d20-be5f-4c75-ae4f-27bf11e74be7 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:33 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ca5f1d20-be5f-4c75-ae4f-27bf11e74be7 Jul 21 02:16:33 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:33 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ca5f1d20-be5f-4c75-ae4f-27bf11e74be7" returned: 0 in 0.268s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:33 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:16:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-52ab126a-266e-400c-8b33-fc7dcf043262 tempest-VolumesDeleteCascade-1628845007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.286s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:33 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-52ab126a-266e-400c-8b33-fc7dcf043262 tempest-VolumesDeleteCascade-1628845007 None] Creating offline snapshot 5d4854bc-01b4-4277-8b90-7197c2a1f445 of volume 681a1adb-5694-4447-9aef-d55b2da11b98 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:16:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9b2de2-b774-4ce8-8375-22edbfc78337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca5f1d20-be5f-4c75-ae4f-27bf11e74be7', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (104134b9-91ad-45c5-a4f4-1b35d77125e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:33 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[f924a5d6-90ae-493e-a0f8-ce1597d59c38]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-52ab126a-266e-400c-8b33-fc7dcf043262 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.4dade052-1253-4cbf-9220-7dcbbbfe0664 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:33 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] Volume volume-ca5f1d20-be5f-4c75-ae4f-27bf11e74be7 (ca5f1d20-be5f-4c75-ae4f-27bf11e74be7): created successfully Jul 21 02:16:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (104134b9-91ad-45c5-a4f4-1b35d77125e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] Flow 'volume_create_manager' (85911aff-13b9-4cb8-8cdf-71a2809ea210) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:16:33 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-cbae0cb7-c559-44d5-af9b-dfeb9924db2c tempest-VolumesListAdminTestJSON-965287964 None] Created volume successfully. Jul 21 02:16:33 devstack sudo[99899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.4dade052-1253-4cbf-9220-7dcbbbfe0664 Jul 21 02:16:33 devstack sudo[99899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:34 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:16:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] Flow 'volume_create_manager' (40381348-d753-4633-9fda-45ada0f3c465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:16:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b862158-6a93-4ac8-ae06-dde3039e34ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b862158-6a93-4ac8-ae06-dde3039e34ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-892435132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a2ea364-4b17-4fcc-b1b6-aa1f5c511515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d53697101964ff0a753c5d6ee0de915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:16:34Z,use_quota=True,user_id='87e76faa0bde4e81aa45903cb7f5ce44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f62ca99-4af9-43d7-b0d1-2a392029a562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f62ca99-4af9-43d7-b0d1-2a392029a562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc2e9645-e889-42ce-b208-b01528f33822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc2e9645-e889-42ce-b208-b01528f33822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a2ea364-4b17-4fcc-b1b6-aa1f5c511515', 'volume_name': 'volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64967c60-4090-496b-8f11-69e01a58f57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64967c60-4090-496b-8f11-69e01a58f57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc1a358-2411-4e79-a3a2-fe60a1a82983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:34 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] Volume 3a2ea364-4b17-4fcc-b1b6-aa1f5c511515: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515', 'volume_size': 1} Jul 21 02:16:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:34 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-73b3d682-5eff-41d0-ba3e-cad5c43e0e10 req-82b833ff-0d48-4a84-a58a-9354dd1321d8 tempest-TestStampPattern-361473491 None] Terminate volume connection completed successfully. Jul 21 02:16:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-73b3d682-5eff-41d0-ba3e-cad5c43e0e10 req-82b833ff-0d48-4a84-a58a-9354dd1321d8 tempest-TestStampPattern-361473491 None] Deleting attachment 70f053f5-4e2a-4fdd-bebc-254f47b98090. {{(pid=87566) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 02:16:34 devstack sudo[99899]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-52ab126a-266e-400c-8b33-fc7dcf043262 tempest-VolumesDeleteCascade-1628845007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.4dade052-1253-4cbf-9220-7dcbbbfe0664" returned: 0 in 0.501s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-52ab126a-266e-400c-8b33-fc7dcf043262 tempest-VolumesDeleteCascade-1628845007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-681a1adb-5694-4447-9aef-d55b2da11b98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:16:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-52ab126a-266e-400c-8b33-fc7dcf043262 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.4dade052-1253-4cbf-9220-7dcbbbfe0664,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.5d4854bc-01b4-4277-8b90-7197c2a1f445 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:34 devstack sudo[99933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.4dade052-1253-4cbf-9220-7dcbbbfe0664,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.5d4854bc-01b4-4277-8b90-7197c2a1f445 1G Jul 21 02:16:34 devstack sudo[99933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:34 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-89c1dd5f-9d24-4167-b539-6329401b4b24 tempest-VolumesListAdminTestJSON-965287964 None] Acquiring lock "cinder-ca5f1d20-be5f-4c75-ae4f-27bf11e74be7-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:34 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-89c1dd5f-9d24-4167-b539-6329401b4b24 tempest-VolumesListAdminTestJSON-965287964 None] Lock "cinder-ca5f1d20-be5f-4c75-ae4f-27bf11e74be7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:34 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-89c1dd5f-9d24-4167-b539-6329401b4b24 tempest-VolumesListAdminTestJSON-965287964 None] Acquiring lock "cinder-quobyte-ca5f1d20-be5f-4c75-ae4f-27bf11e74be7" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:34 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-89c1dd5f-9d24-4167-b539-6329401b4b24 tempest-VolumesListAdminTestJSON-965287964 None] Lock "cinder-quobyte-ca5f1d20-be5f-4c75-ae4f-27bf11e74be7" acquired by "delete_volume" :: waited 0.020s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:34 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b92e8ca-aab5-4faf-8f29-2bbcd6130443]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-89c1dd5f-9d24-4167-b539-6329401b4b24 tempest-VolumesListAdminTestJSON-965287964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ca5f1d20-be5f-4c75-ae4f-27bf11e74be7 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:34 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-313b9602-9bc3-4fb3-b9a4-b4e064c71e17 tempest-VolumesListAdminTestJSON-512470297 None] Acquiring lock "cinder-64b8849f-cd5e-448a-b71d-0d8b361f02ba-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:34 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-313b9602-9bc3-4fb3-b9a4-b4e064c71e17 tempest-VolumesListAdminTestJSON-512470297 None] Lock "cinder-64b8849f-cd5e-448a-b71d-0d8b361f02ba-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:34 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-313b9602-9bc3-4fb3-b9a4-b4e064c71e17 tempest-VolumesListAdminTestJSON-512470297 None] Acquiring lock "cinder-quobyte-64b8849f-cd5e-448a-b71d-0d8b361f02ba" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:34 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-313b9602-9bc3-4fb3-b9a4-b4e064c71e17 tempest-VolumesListAdminTestJSON-512470297 None] Lock "cinder-quobyte-64b8849f-cd5e-448a-b71d-0d8b361f02ba" acquired by "delete_volume" :: waited 0.016s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:34 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[407131e1-5e86-4b19-9198-fb6e4e5025da]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-313b9602-9bc3-4fb3-b9a4-b4e064c71e17 tempest-VolumesListAdminTestJSON-512470297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b8849f-cd5e-448a-b71d-0d8b361f02ba {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:34 devstack sudo[99935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ca5f1d20-be5f-4c75-ae4f-27bf11e74be7 Jul 21 02:16:34 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:34 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b8849f-cd5e-448a-b71d-0d8b361f02ba Jul 21 02:16:34 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:34 devstack sudo[99933]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-52ab126a-266e-400c-8b33-fc7dcf043262 tempest-VolumesDeleteCascade-1628845007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.4dade052-1253-4cbf-9220-7dcbbbfe0664,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.5d4854bc-01b4-4277-8b90-7197c2a1f445 1G" returned: 0 in 0.523s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-52ab126a-266e-400c-8b33-fc7dcf043262 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-681a1adb-5694-4447-9aef-d55b2da11b98.4dade052-1253-4cbf-9220-7dcbbbfe0664 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.5d4854bc-01b4-4277-8b90-7197c2a1f445 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:34 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-681a1adb-5694-4447-9aef-d55b2da11b98.4dade052-1253-4cbf-9220-7dcbbbfe0664 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.5d4854bc-01b4-4277-8b90-7197c2a1f445 Jul 21 02:16:34 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:34 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-89c1dd5f-9d24-4167-b539-6329401b4b24 tempest-VolumesListAdminTestJSON-965287964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ca5f1d20-be5f-4c75-ae4f-27bf11e74be7" returned: 0 in 0.491s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-89c1dd5f-9d24-4167-b539-6329401b4b24 tempest-VolumesListAdminTestJSON-965287964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ca5f1d20-be5f-4c75-ae4f-27bf11e74be7 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:34 devstack sudo[99950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ca5f1d20-be5f-4c75-ae4f-27bf11e74be7 Jul 21 02:16:35 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:35 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-313b9602-9bc3-4fb3-b9a4-b4e064c71e17 tempest-VolumesListAdminTestJSON-512470297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b8849f-cd5e-448a-b71d-0d8b361f02ba" returned: 0 in 0.432s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-313b9602-9bc3-4fb3-b9a4-b4e064c71e17 tempest-VolumesListAdminTestJSON-512470297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b8849f-cd5e-448a-b71d-0d8b361f02ba {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:35 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b8849f-cd5e-448a-b71d-0d8b361f02ba Jul 21 02:16:35 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:35 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-52ab126a-266e-400c-8b33-fc7dcf043262 tempest-VolumesDeleteCascade-1628845007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-681a1adb-5694-4447-9aef-d55b2da11b98.4dade052-1253-4cbf-9220-7dcbbbfe0664 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.5d4854bc-01b4-4277-8b90-7197c2a1f445" returned: 0 in 0.396s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:35 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-52ab126a-266e-400c-8b33-fc7dcf043262 tempest-VolumesDeleteCascade-1628845007 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.5d4854bc-01b4-4277-8b90-7197c2a1f445 is being set with open permissions: ugo+rw Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-52ab126a-266e-400c-8b33-fc7dcf043262 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.5d4854bc-01b4-4277-8b90-7197c2a1f445 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:35 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:35 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.5d4854bc-01b4-4277-8b90-7197c2a1f445 Jul 21 02:16:35 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-89c1dd5f-9d24-4167-b539-6329401b4b24 tempest-VolumesListAdminTestJSON-965287964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ca5f1d20-be5f-4c75-ae4f-27bf11e74be7" returned: 0 in 0.287s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-89c1dd5f-9d24-4167-b539-6329401b4b24 tempest-VolumesListAdminTestJSON-965287964 None] Lock "cinder-quobyte-ca5f1d20-be5f-4c75-ae4f-27bf11e74be7" released by "delete_volume" :: held 0.839s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-89c1dd5f-9d24-4167-b539-6329401b4b24 tempest-VolumesListAdminTestJSON-965287964 None] Created reservations ['4d2e46e2-1145-4f5f-adb4-8b5c2c1ccd57', '6baed758-2eb7-4b01-b094-2cc49f35b61a', '8c7cfac7-9f7a-40e9-afa3-bc27f40cf7ed', '7883e11c-668d-4d24-9716-728b6b5caa81'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:16:35 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-313b9602-9bc3-4fb3-b9a4-b4e064c71e17 tempest-VolumesListAdminTestJSON-512470297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-64b8849f-cd5e-448a-b71d-0d8b361f02ba" returned: 0 in 0.289s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-313b9602-9bc3-4fb3-b9a4-b4e064c71e17 tempest-VolumesListAdminTestJSON-512470297 None] Lock "cinder-quobyte-64b8849f-cd5e-448a-b71d-0d8b361f02ba" released by "delete_volume" :: held 0.769s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-89c1dd5f-9d24-4167-b539-6329401b4b24 tempest-VolumesListAdminTestJSON-965287964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-89c1dd5f-9d24-4167-b539-6329401b4b24 tempest-VolumesListAdminTestJSON-965287964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-89c1dd5f-9d24-4167-b539-6329401b4b24 tempest-VolumesListAdminTestJSON-965287964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-89c1dd5f-9d24-4167-b539-6329401b4b24 tempest-VolumesListAdminTestJSON-965287964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-89c1dd5f-9d24-4167-b539-6329401b4b24 tempest-VolumesListAdminTestJSON-965287964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-89c1dd5f-9d24-4167-b539-6329401b4b24 tempest-VolumesListAdminTestJSON-965287964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-313b9602-9bc3-4fb3-b9a4-b4e064c71e17 tempest-VolumesListAdminTestJSON-512470297 None] Created reservations ['527cdcd0-5c5a-46b6-8064-2618dbfd2ee6', '4936d57f-485d-4af1-b7e9-85b47d1e35d9', '2b02099b-04f2-411d-8f7a-c1c3b711ffeb', '9e662fa6-0c61-4e0e-8352-b74875666f95'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:16:35 devstack sudo[99964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:16:35 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:35 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-52ab126a-266e-400c-8b33-fc7dcf043262 tempest-VolumesDeleteCascade-1628845007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.5d4854bc-01b4-4277-8b90-7197c2a1f445" returned: 0 in 0.296s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-52ab126a-266e-400c-8b33-fc7dcf043262 tempest-VolumesDeleteCascade-1628845007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.898s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.390s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-892435132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a2ea364-4b17-4fcc-b1b6-aa1f5c511515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d53697101964ff0a753c5d6ee0de915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:16:34Z,use_quota=True,user_id='87e76faa0bde4e81aa45903cb7f5ce44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] Creating volume 3a2ea364-4b17-4fcc-b1b6-aa1f5c511515 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:16:35 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:35 devstack sudo[99966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515 1073741824 Jul 21 02:16:35 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:35 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-52ab126a-266e-400c-8b33-fc7dcf043262 tempest-VolumesDeleteCascade-1628845007 None] Create snapshot completed successfully Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-313b9602-9bc3-4fb3-b9a4-b4e064c71e17 tempest-VolumesListAdminTestJSON-512470297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-313b9602-9bc3-4fb3-b9a4-b4e064c71e17 tempest-VolumesListAdminTestJSON-512470297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-313b9602-9bc3-4fb3-b9a4-b4e064c71e17 tempest-VolumesListAdminTestJSON-512470297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-313b9602-9bc3-4fb3-b9a4-b4e064c71e17 tempest-VolumesListAdminTestJSON-512470297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-313b9602-9bc3-4fb3-b9a4-b4e064c71e17 tempest-VolumesListAdminTestJSON-512470297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-313b9602-9bc3-4fb3-b9a4-b4e064c71e17 tempest-VolumesListAdminTestJSON-512470297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:35 devstack sudo[99969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:16:35 devstack sudo[99969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:35 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-89c1dd5f-9d24-4167-b539-6329401b4b24 tempest-VolumesListAdminTestJSON-965287964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.371s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-89c1dd5f-9d24-4167-b539-6329401b4b24 tempest-VolumesListAdminTestJSON-965287964 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:16:35 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-89c1dd5f-9d24-4167-b539-6329401b4b24 tempest-VolumesListAdminTestJSON-965287964 None] Deleted volume successfully. Jul 21 02:16:35 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-89c1dd5f-9d24-4167-b539-6329401b4b24 tempest-VolumesListAdminTestJSON-965287964 None] Lock "cinder-ca5f1d20-be5f-4c75-ae4f-27bf11e74be7-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:36 devstack sudo[99969]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-313b9602-9bc3-4fb3-b9a4-b4e064c71e17 tempest-VolumesListAdminTestJSON-512470297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.443s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:36 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-313b9602-9bc3-4fb3-b9a4-b4e064c71e17 tempest-VolumesListAdminTestJSON-512470297 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:16:36 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-313b9602-9bc3-4fb3-b9a4-b4e064c71e17 tempest-VolumesListAdminTestJSON-512470297 None] Deleted volume successfully. Jul 21 02:16:36 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-313b9602-9bc3-4fb3-b9a4-b4e064c71e17 tempest-VolumesListAdminTestJSON-512470297 None] Lock "cinder-64b8849f-cd5e-448a-b71d-0d8b361f02ba-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:36 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-58675408-c437-4149-b5c5-c11b2f1ec813 tempest-VolumesListAdminTestJSON-512470297 None] Acquiring lock "cinder-59855606-a0b0-45cd-980a-688ff0b54914-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:36 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-58675408-c437-4149-b5c5-c11b2f1ec813 tempest-VolumesListAdminTestJSON-512470297 None] Lock "cinder-59855606-a0b0-45cd-980a-688ff0b54914-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:36 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-58675408-c437-4149-b5c5-c11b2f1ec813 tempest-VolumesListAdminTestJSON-512470297 None] Acquiring lock "cinder-quobyte-59855606-a0b0-45cd-980a-688ff0b54914" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:36 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-58675408-c437-4149-b5c5-c11b2f1ec813 tempest-VolumesListAdminTestJSON-512470297 None] Lock "cinder-quobyte-59855606-a0b0-45cd-980a-688ff0b54914" acquired by "delete_volume" :: waited 0.022s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:36 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515 1073741824" returned: 0 in 0.812s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:36 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a91713b-c8fa-4380-b1e0-3756b06184ad]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-58675408-c437-4149-b5c5-c11b2f1ec813 tempest-VolumesListAdminTestJSON-512470297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-59855606-a0b0-45cd-980a-688ff0b54914 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:36 devstack sudo[99982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515 Jul 21 02:16:36 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:36 devstack sudo[99981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-59855606-a0b0-45cd-980a-688ff0b54914 Jul 21 02:16:36 devstack sudo[99981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:36 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Acquiring lock "cinder-681a1adb-5694-4447-9aef-d55b2da11b98-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:36 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-681a1adb-5694-4447-9aef-d55b2da11b98-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:36 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Performing cascade delete. {{(pid=87566) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 21 02:16:36 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Acquiring lock "cinder-4dade052-1253-4cbf-9220-7dcbbbfe0664-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:36 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-4dade052-1253-4cbf-9220-7dcbbbfe0664-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:36 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Acquiring lock "cinder-quobyte-681a1adb-5694-4447-9aef-d55b2da11b98" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:36 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515" returned: 0 in 0.522s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:36 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] <== create_volume: return (1414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:16:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:37 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-quobyte-681a1adb-5694-4447-9aef-d55b2da11b98" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:37 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Acquiring lock "cinder-quobyte-4dade052-1253-4cbf-9220-7dcbbbfe0664" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc1a358-2411-4e79-a3a2-fe60a1a82983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b890af01-fc87-4f94-a45b-60a78270fe40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:37 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-quobyte-4dade052-1253-4cbf-9220-7dcbbbfe0664" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:37 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Deleting offline snapshot 4dade052-1253-4cbf-9220-7dcbbbfe0664 of volume 681a1adb-5694-4447-9aef-d55b2da11b98 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:16:37 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] snapshot_file for this snap is: volume-681a1adb-5694-4447-9aef-d55b2da11b98.4dade052-1253-4cbf-9220-7dcbbbfe0664 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:16:37 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] Volume volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515 (3a2ea364-4b17-4fcc-b1b6-aa1f5c511515): created successfully Jul 21 02:16:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b890af01-fc87-4f94-a45b-60a78270fe40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] Flow 'volume_create_manager' (40381348-d753-4633-9fda-45ada0f3c465) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:16:37 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[658fdcb3-65bc-4a82-959f-bd284edc6d5f]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.4dade052-1253-4cbf-9220-7dcbbbfe0664 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:37 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-1ecd28a3-1475-46b2-a263-f725786e750b tempest-VolumesSnapshotListTestJSON-1430186320 None] Created volume successfully. Jul 21 02:16:37 devstack sudo[99981]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-58675408-c437-4149-b5c5-c11b2f1ec813 tempest-VolumesListAdminTestJSON-512470297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-59855606-a0b0-45cd-980a-688ff0b54914" returned: 0 in 0.792s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-58675408-c437-4149-b5c5-c11b2f1ec813 tempest-VolumesListAdminTestJSON-512470297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-59855606-a0b0-45cd-980a-688ff0b54914 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:37 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-59855606-a0b0-45cd-980a-688ff0b54914 Jul 21 02:16:37 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:37 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.4dade052-1253-4cbf-9220-7dcbbbfe0664 Jul 21 02:16:37 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:37 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.4dade052-1253-4cbf-9220-7dcbbbfe0664" returned: 0 in 0.409s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:37 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-681a1adb-5694-4447-9aef-d55b2da11b98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:16:37 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:37 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[3462acf5-e19a-476f-8b8f-f7af422a47d6]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-58675408-c437-4149-b5c5-c11b2f1ec813 tempest-VolumesListAdminTestJSON-512470297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-59855606-a0b0-45cd-980a-688ff0b54914" returned: 0 in 0.406s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:37 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-58675408-c437-4149-b5c5-c11b2f1ec813 tempest-VolumesListAdminTestJSON-512470297 None] Lock "cinder-quobyte-59855606-a0b0-45cd-980a-688ff0b54914" released by "delete_volume" :: held 1.270s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c5b670a2-3612-41b9-97ca-81059757c6e5 tempest-VolumesSnapshotListTestJSON-1430186320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c5b670a2-3612-41b9-97ca-81059757c6e5 tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:37 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-c5b670a2-3612-41b9-97ca-81059757c6e5 tempest-VolumesSnapshotListTestJSON-1430186320 None] Creating offline snapshot 6fc4c35a-0be5-440a-8f08-714927380539 of volume 3a2ea364-4b17-4fcc-b1b6-aa1f5c511515 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:16:37 devstack sudo[100018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98 Jul 21 02:16:37 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:37 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[833bef85-8be6-4c1f-9c40-d5552470e822]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c5b670a2-3612-41b9-97ca-81059757c6e5 tempest-VolumesSnapshotListTestJSON-1430186320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:37 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-58675408-c437-4149-b5c5-c11b2f1ec813 tempest-VolumesListAdminTestJSON-512470297 None] Created reservations ['5dae55e1-b5a0-4983-a149-7272b869635b', '599c59cd-feea-4783-b1fa-201c4d052165', 'd3a7c474-ea84-43b4-ab91-7295e248caf1', 'b01b9293-8756-4c41-bc00-ff37262e12b4'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:16:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-58675408-c437-4149-b5c5-c11b2f1ec813 tempest-VolumesListAdminTestJSON-512470297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-58675408-c437-4149-b5c5-c11b2f1ec813 tempest-VolumesListAdminTestJSON-512470297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:37 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-58675408-c437-4149-b5c5-c11b2f1ec813 tempest-VolumesListAdminTestJSON-512470297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:16:37 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-58675408-c437-4149-b5c5-c11b2f1ec813 tempest-VolumesListAdminTestJSON-512470297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:16:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-58675408-c437-4149-b5c5-c11b2f1ec813 tempest-VolumesListAdminTestJSON-512470297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-58675408-c437-4149-b5c5-c11b2f1ec813 tempest-VolumesListAdminTestJSON-512470297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:37 devstack sudo[100021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:16:37 devstack sudo[100021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:37 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515 Jul 21 02:16:37 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:38 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98" returned: 0 in 0.587s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:38 devstack sudo[100021]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-58675408-c437-4149-b5c5-c11b2f1ec813 tempest-VolumesListAdminTestJSON-512470297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.370s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:38 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-58675408-c437-4149-b5c5-c11b2f1ec813 tempest-VolumesListAdminTestJSON-512470297 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:16:38 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[946b0744-ac8a-436b-8f18-00984d5384d3]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.5d4854bc-01b4-4277-8b90-7197c2a1f445 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:38 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-58675408-c437-4149-b5c5-c11b2f1ec813 tempest-VolumesListAdminTestJSON-512470297 None] Deleted volume successfully. Jul 21 02:16:38 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-58675408-c437-4149-b5c5-c11b2f1ec813 tempest-VolumesListAdminTestJSON-512470297 None] Lock "cinder-59855606-a0b0-45cd-980a-688ff0b54914-delete_volume" released by "delete_volume" :: held 2.010s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:38 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c5b670a2-3612-41b9-97ca-81059757c6e5 tempest-VolumesSnapshotListTestJSON-1430186320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515" returned: 0 in 0.589s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c5b670a2-3612-41b9-97ca-81059757c6e5 tempest-VolumesSnapshotListTestJSON-1430186320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.6fc4c35a-0be5-440a-8f08-714927380539 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:38 devstack sudo[100033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.6fc4c35a-0be5-440a-8f08-714927380539 1G Jul 21 02:16:38 devstack sudo[100033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:38 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.5d4854bc-01b4-4277-8b90-7197c2a1f445 Jul 21 02:16:38 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:38 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d5e25bb3-ffee-4f84-b5f4-40dcc2b624e2 tempest-VolumesListAdminTestJSON-512470297 None] Acquiring lock "cinder-6dcb15f4-0e19-45cc-89fa-892b729b5c2f-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:38 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d5e25bb3-ffee-4f84-b5f4-40dcc2b624e2 tempest-VolumesListAdminTestJSON-512470297 None] Lock "cinder-6dcb15f4-0e19-45cc-89fa-892b729b5c2f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:38 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.5d4854bc-01b4-4277-8b90-7197c2a1f445" returned: 0 in 0.467s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:38 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-681a1adb-5694-4447-9aef-d55b2da11b98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:16:38 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[78de5704-7f2d-4f35-9aa0-977704d43106]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.4dade052-1253-4cbf-9220-7dcbbbfe0664 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:38 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d5e25bb3-ffee-4f84-b5f4-40dcc2b624e2 tempest-VolumesListAdminTestJSON-512470297 None] Acquiring lock "cinder-quobyte-6dcb15f4-0e19-45cc-89fa-892b729b5c2f" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:38 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d5e25bb3-ffee-4f84-b5f4-40dcc2b624e2 tempest-VolumesListAdminTestJSON-512470297 None] Lock "cinder-quobyte-6dcb15f4-0e19-45cc-89fa-892b729b5c2f" acquired by "delete_volume" :: waited 0.020s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:38 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[4768893b-4890-480a-be96-1c767e47073a]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d5e25bb3-ffee-4f84-b5f4-40dcc2b624e2 tempest-VolumesListAdminTestJSON-512470297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6dcb15f4-0e19-45cc-89fa-892b729b5c2f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:38 devstack sudo[100033]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c5b670a2-3612-41b9-97ca-81059757c6e5 tempest-VolumesSnapshotListTestJSON-1430186320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.6fc4c35a-0be5-440a-8f08-714927380539 1G" returned: 0 in 0.513s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c5b670a2-3612-41b9-97ca-81059757c6e5 tempest-VolumesSnapshotListTestJSON-1430186320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.6fc4c35a-0be5-440a-8f08-714927380539 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:38 devstack sudo[100043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.4dade052-1253-4cbf-9220-7dcbbbfe0664 Jul 21 02:16:38 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:38 devstack sudo[100045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.6fc4c35a-0be5-440a-8f08-714927380539 Jul 21 02:16:38 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:38 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6dcb15f4-0e19-45cc-89fa-892b729b5c2f Jul 21 02:16:38 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:39 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4ecd5413-e17b-4d80-9ebf-5c27be44e734 tempest-TestStampPattern-361473491 None] Acquiring lock "cinder-1790d7c5-4bb0-4564-a02f-2b1750332755-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:39 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4ecd5413-e17b-4d80-9ebf-5c27be44e734 tempest-TestStampPattern-361473491 None] Lock "cinder-1790d7c5-4bb0-4564-a02f-2b1750332755-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:39 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.4dade052-1253-4cbf-9220-7dcbbbfe0664" returned: 0 in 0.465s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-681a1adb-5694-4447-9aef-d55b2da11b98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:16:39 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:39 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[513b6680-cfd3-43fe-b97d-f53227099392]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:39 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c5b670a2-3612-41b9-97ca-81059757c6e5 tempest-VolumesSnapshotListTestJSON-1430186320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.6fc4c35a-0be5-440a-8f08-714927380539" returned: 0 in 0.397s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:39 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-c5b670a2-3612-41b9-97ca-81059757c6e5 tempest-VolumesSnapshotListTestJSON-1430186320 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.6fc4c35a-0be5-440a-8f08-714927380539 is being set with open permissions: ugo+rw Jul 21 02:16:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c5b670a2-3612-41b9-97ca-81059757c6e5 tempest-VolumesSnapshotListTestJSON-1430186320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.6fc4c35a-0be5-440a-8f08-714927380539 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:39 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4ecd5413-e17b-4d80-9ebf-5c27be44e734 tempest-TestStampPattern-361473491 None] Acquiring lock "cinder-quobyte-1790d7c5-4bb0-4564-a02f-2b1750332755" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d5e25bb3-ffee-4f84-b5f4-40dcc2b624e2 tempest-VolumesListAdminTestJSON-512470297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6dcb15f4-0e19-45cc-89fa-892b729b5c2f" returned: 0 in 0.456s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d5e25bb3-ffee-4f84-b5f4-40dcc2b624e2 tempest-VolumesListAdminTestJSON-512470297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6dcb15f4-0e19-45cc-89fa-892b729b5c2f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:39 devstack sudo[100060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.6fc4c35a-0be5-440a-8f08-714927380539 Jul 21 02:16:39 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:39 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4ecd5413-e17b-4d80-9ebf-5c27be44e734 tempest-TestStampPattern-361473491 None] Lock "cinder-quobyte-1790d7c5-4bb0-4564-a02f-2b1750332755" acquired by "delete_volume" :: waited 0.037s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:39 devstack sudo[100061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6dcb15f4-0e19-45cc-89fa-892b729b5c2f Jul 21 02:16:39 devstack sudo[100061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:39 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2534aa-0ddd-4e16-b31c-f78f21e2811a]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4ecd5413-e17b-4d80-9ebf-5c27be44e734 tempest-TestStampPattern-361473491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1790d7c5-4bb0-4564-a02f-2b1750332755 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:39 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98 Jul 21 02:16:39 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:39 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1790d7c5-4bb0-4564-a02f-2b1750332755 Jul 21 02:16:39 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:39 devstack sudo[100061]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d5e25bb3-ffee-4f84-b5f4-40dcc2b624e2 tempest-VolumesListAdminTestJSON-512470297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6dcb15f4-0e19-45cc-89fa-892b729b5c2f" returned: 0 in 0.310s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:39 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d5e25bb3-ffee-4f84-b5f4-40dcc2b624e2 tempest-VolumesListAdminTestJSON-512470297 None] Lock "cinder-quobyte-6dcb15f4-0e19-45cc-89fa-892b729b5c2f" released by "delete_volume" :: held 0.810s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:39 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:39 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c5b670a2-3612-41b9-97ca-81059757c6e5 tempest-VolumesSnapshotListTestJSON-1430186320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.6fc4c35a-0be5-440a-8f08-714927380539" returned: 0 in 0.358s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98" returned: 0 in 0.377s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.4dade052-1253-4cbf-9220-7dcbbbfe0664 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:39 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.4dade052-1253-4cbf-9220-7dcbbbfe0664 Jul 21 02:16:39 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c5b670a2-3612-41b9-97ca-81059757c6e5 tempest-VolumesSnapshotListTestJSON-1430186320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:39 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-d5e25bb3-ffee-4f84-b5f4-40dcc2b624e2 tempest-VolumesListAdminTestJSON-512470297 None] Created reservations ['06f22fd6-6645-4fb3-a56e-688c926f97ba', 'e19b4861-c5f6-4872-b315-b6da0a28bb84', '396f20e2-1c72-45c0-8f4a-0e6d61ea84ab', 'b1c90360-5448-405f-8f2a-53ac3bd9c7d8'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:16:39 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.info Jul 21 02:16:39 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:39 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4ecd5413-e17b-4d80-9ebf-5c27be44e734 tempest-TestStampPattern-361473491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1790d7c5-4bb0-4564-a02f-2b1750332755" returned: 0 in 0.444s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4ecd5413-e17b-4d80-9ebf-5c27be44e734 tempest-TestStampPattern-361473491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1790d7c5-4bb0-4564-a02f-2b1750332755 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d5e25bb3-ffee-4f84-b5f4-40dcc2b624e2 tempest-VolumesListAdminTestJSON-512470297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d5e25bb3-ffee-4f84-b5f4-40dcc2b624e2 tempest-VolumesListAdminTestJSON-512470297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d5e25bb3-ffee-4f84-b5f4-40dcc2b624e2 tempest-VolumesListAdminTestJSON-512470297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:16:39 devstack sudo[100080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1790d7c5-4bb0-4564-a02f-2b1750332755 Jul 21 02:16:39 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d5e25bb3-ffee-4f84-b5f4-40dcc2b624e2 tempest-VolumesListAdminTestJSON-512470297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:16:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d5e25bb3-ffee-4f84-b5f4-40dcc2b624e2 tempest-VolumesListAdminTestJSON-512470297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d5e25bb3-ffee-4f84-b5f4-40dcc2b624e2 tempest-VolumesListAdminTestJSON-512470297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:39 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:16:39 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:39 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c5b670a2-3612-41b9-97ca-81059757c6e5 tempest-VolumesSnapshotListTestJSON-1430186320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.info" returned: 0 in 0.331s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:39 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-c5b670a2-3612-41b9-97ca-81059757c6e5 tempest-VolumesSnapshotListTestJSON-1430186320 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.info is being set with open permissions: ugo+rw Jul 21 02:16:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c5b670a2-3612-41b9-97ca-81059757c6e5 tempest-VolumesSnapshotListTestJSON-1430186320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:40 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.info Jul 21 02:16:40 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:40 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.4dade052-1253-4cbf-9220-7dcbbbfe0664" returned: 0 in 0.515s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.4dade052-1253-4cbf-9220-7dcbbbfe0664 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:40 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4ecd5413-e17b-4d80-9ebf-5c27be44e734 tempest-TestStampPattern-361473491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1790d7c5-4bb0-4564-a02f-2b1750332755" returned: 0 in 0.385s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:40 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.4dade052-1253-4cbf-9220-7dcbbbfe0664 Jul 21 02:16:40 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:40 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4ecd5413-e17b-4d80-9ebf-5c27be44e734 tempest-TestStampPattern-361473491 None] Lock "cinder-quobyte-1790d7c5-4bb0-4564-a02f-2b1750332755" released by "delete_volume" :: held 0.893s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:40 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-4ecd5413-e17b-4d80-9ebf-5c27be44e734 tempest-TestStampPattern-361473491 None] Created reservations ['1f21640d-981b-4b33-9b8f-a6d054081969', 'd1a6fdc4-6bd0-42f1-8e7c-2b4fa13f2c00', 'd100c1eb-469d-4a3e-9dc8-171125a94e5c', 'b39c9cb4-a1b9-460b-872f-8f5c6ebe7f84'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:16:40 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d5e25bb3-ffee-4f84-b5f4-40dcc2b624e2 tempest-VolumesListAdminTestJSON-512470297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.511s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:40 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-d5e25bb3-ffee-4f84-b5f4-40dcc2b624e2 tempest-VolumesListAdminTestJSON-512470297 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:16:40 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-d5e25bb3-ffee-4f84-b5f4-40dcc2b624e2 tempest-VolumesListAdminTestJSON-512470297 None] Deleted volume successfully. Jul 21 02:16:40 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d5e25bb3-ffee-4f84-b5f4-40dcc2b624e2 tempest-VolumesListAdminTestJSON-512470297 None] Lock "cinder-6dcb15f4-0e19-45cc-89fa-892b729b5c2f-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4ecd5413-e17b-4d80-9ebf-5c27be44e734 tempest-TestStampPattern-361473491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4ecd5413-e17b-4d80-9ebf-5c27be44e734 tempest-TestStampPattern-361473491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:40 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4ecd5413-e17b-4d80-9ebf-5c27be44e734 tempest-TestStampPattern-361473491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:16:40 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:40 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4ecd5413-e17b-4d80-9ebf-5c27be44e734 tempest-TestStampPattern-361473491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:16:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4ecd5413-e17b-4d80-9ebf-5c27be44e734 tempest-TestStampPattern-361473491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4ecd5413-e17b-4d80-9ebf-5c27be44e734 tempest-TestStampPattern-361473491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c5b670a2-3612-41b9-97ca-81059757c6e5 tempest-VolumesSnapshotListTestJSON-1430186320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.info" returned: 0 in 0.390s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c5b670a2-3612-41b9-97ca-81059757c6e5 tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.744s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:40 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:16:40 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:40 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-c5b670a2-3612-41b9-97ca-81059757c6e5 tempest-VolumesSnapshotListTestJSON-1430186320 None] Create snapshot completed successfully Jul 21 02:16:40 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.4dade052-1253-4cbf-9220-7dcbbbfe0664" returned: 0 in 0.370s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-681a1adb-5694-4447-9aef-d55b2da11b98 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.5d4854bc-01b4-4277-8b90-7197c2a1f445 -F qcow2 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:40 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-681a1adb-5694-4447-9aef-d55b2da11b98 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.5d4854bc-01b4-4277-8b90-7197c2a1f445 -F qcow2 Jul 21 02:16:40 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:40 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4ecd5413-e17b-4d80-9ebf-5c27be44e734 tempest-TestStampPattern-361473491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.260s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:40 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-4ecd5413-e17b-4d80-9ebf-5c27be44e734 tempest-TestStampPattern-361473491 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:16:40 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-4ecd5413-e17b-4d80-9ebf-5c27be44e734 tempest-TestStampPattern-361473491 None] Deleted volume successfully. Jul 21 02:16:40 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4ecd5413-e17b-4d80-9ebf-5c27be44e734 tempest-TestStampPattern-361473491 None] Lock "cinder-1790d7c5-4bb0-4564-a02f-2b1750332755-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:40 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-681a1adb-5694-4447-9aef-d55b2da11b98 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.5d4854bc-01b4-4277-8b90-7197c2a1f445 -F qcow2" returned: 0 in 0.335s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:40 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-quobyte-4dade052-1253-4cbf-9220-7dcbbbfe0664" released by "_delete_snapshot" :: held 3.780s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:40 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-quobyte-681a1adb-5694-4447-9aef-d55b2da11b98" released by "delete_snapshot" :: held 3.845s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:40 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Created reservations ['bf7e28ba-a410-4b7a-875d-1a1b83962cc5', '6d3fd785-54c6-4bbc-a874-3f086175fb8e', '966a9279-a2d4-4fec-88b7-25536bded1f6', '73de62cc-afad-4a15-8e99-bd8188a650bf'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:16:40 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Delete snapshot completed successfully. Jul 21 02:16:41 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-4dade052-1253-4cbf-9220-7dcbbbfe0664-delete_snapshot" released by "delete_snapshot" :: held 4.068s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:41 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Acquiring lock "cinder-5d4854bc-01b4-4277-8b90-7197c2a1f445-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:41 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-5d4854bc-01b4-4277-8b90-7197c2a1f445-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-374bce6d-ef23-47b8-b45a-fa1e562985e1 tempest-VolumesSnapshotListTestJSON-1430186320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-374bce6d-ef23-47b8-b45a-fa1e562985e1 tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:41 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Acquiring lock "cinder-quobyte-681a1adb-5694-4447-9aef-d55b2da11b98" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:41 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-374bce6d-ef23-47b8-b45a-fa1e562985e1 tempest-VolumesSnapshotListTestJSON-1430186320 None] Creating offline snapshot abb71abb-ed21-46c7-994d-5609b1da4317 of volume 3a2ea364-4b17-4fcc-b1b6-aa1f5c511515 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:16:41 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-quobyte-681a1adb-5694-4447-9aef-d55b2da11b98" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:41 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Acquiring lock "cinder-quobyte-5d4854bc-01b4-4277-8b90-7197c2a1f445" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:41 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3476b5-7c6b-436c-b25d-2fb2e8650e49]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-374bce6d-ef23-47b8-b45a-fa1e562985e1 tempest-VolumesSnapshotListTestJSON-1430186320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.6fc4c35a-0be5-440a-8f08-714927380539 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:41 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-quobyte-5d4854bc-01b4-4277-8b90-7197c2a1f445" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:41 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Deleting offline snapshot 5d4854bc-01b4-4277-8b90-7197c2a1f445 of volume 681a1adb-5694-4447-9aef-d55b2da11b98 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:16:41 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] snapshot_file for this snap is: volume-681a1adb-5694-4447-9aef-d55b2da11b98.5d4854bc-01b4-4277-8b90-7197c2a1f445 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:16:41 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cf82f5-8859-41d3-b204-1f0f67b04f9f]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.5d4854bc-01b4-4277-8b90-7197c2a1f445 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:41 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.6fc4c35a-0be5-440a-8f08-714927380539 Jul 21 02:16:41 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:41 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.5d4854bc-01b4-4277-8b90-7197c2a1f445 Jul 21 02:16:41 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:41 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-374bce6d-ef23-47b8-b45a-fa1e562985e1 tempest-VolumesSnapshotListTestJSON-1430186320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.6fc4c35a-0be5-440a-8f08-714927380539" returned: 0 in 0.427s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:41 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-374bce6d-ef23-47b8-b45a-fa1e562985e1 tempest-VolumesSnapshotListTestJSON-1430186320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:16:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-374bce6d-ef23-47b8-b45a-fa1e562985e1 tempest-VolumesSnapshotListTestJSON-1430186320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.6fc4c35a-0be5-440a-8f08-714927380539,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.abb71abb-ed21-46c7-994d-5609b1da4317 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:41 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.6fc4c35a-0be5-440a-8f08-714927380539,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.abb71abb-ed21-46c7-994d-5609b1da4317 1G Jul 21 02:16:41 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:41 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.5d4854bc-01b4-4277-8b90-7197c2a1f445" returned: 0 in 0.511s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:41 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-681a1adb-5694-4447-9aef-d55b2da11b98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:16:41 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fbd4e4-d2b1-4b83-8da7-07a8938b7c60]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:41 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8d08c666-62fe-4a51-8f2e-64c668e12b8b tempest-TestStampPattern-361473491 None] Acquiring lock "cinder-6ed3d37a-1c46-45de-bef9-0eeffd11a2e7-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:41 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8d08c666-62fe-4a51-8f2e-64c668e12b8b tempest-TestStampPattern-361473491 None] Lock "cinder-6ed3d37a-1c46-45de-bef9-0eeffd11a2e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:41 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8d08c666-62fe-4a51-8f2e-64c668e12b8b tempest-TestStampPattern-361473491 None] Acquiring lock "cinder-quobyte-524d5171-eb4e-4c04-bfff-1f6acf19972b" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:41 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8d08c666-62fe-4a51-8f2e-64c668e12b8b tempest-TestStampPattern-361473491 None] Lock "cinder-quobyte-524d5171-eb4e-4c04-bfff-1f6acf19972b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:41 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8d08c666-62fe-4a51-8f2e-64c668e12b8b tempest-TestStampPattern-361473491 None] Acquiring lock "cinder-quobyte-6ed3d37a-1c46-45de-bef9-0eeffd11a2e7" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:41 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8d08c666-62fe-4a51-8f2e-64c668e12b8b tempest-TestStampPattern-361473491 None] Lock "cinder-quobyte-6ed3d37a-1c46-45de-bef9-0eeffd11a2e7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:41 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-8d08c666-62fe-4a51-8f2e-64c668e12b8b tempest-TestStampPattern-361473491 None] Deleting offline snapshot 6ed3d37a-1c46-45de-bef9-0eeffd11a2e7 of volume 524d5171-eb4e-4c04-bfff-1f6acf19972b {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:16:41 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-8d08c666-62fe-4a51-8f2e-64c668e12b8b tempest-TestStampPattern-361473491 None] snapshot_file for this snap is: volume-524d5171-eb4e-4c04-bfff-1f6acf19972b.6ed3d37a-1c46-45de-bef9-0eeffd11a2e7 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:16:41 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98 Jul 21 02:16:41 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:41 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdf22b8-3901-439d-a6ea-9cd346e51393]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8d08c666-62fe-4a51-8f2e-64c668e12b8b tempest-TestStampPattern-361473491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b.6ed3d37a-1c46-45de-bef9-0eeffd11a2e7 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:42 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b.6ed3d37a-1c46-45de-bef9-0eeffd11a2e7 Jul 21 02:16:42 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:42 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-374bce6d-ef23-47b8-b45a-fa1e562985e1 tempest-VolumesSnapshotListTestJSON-1430186320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.6fc4c35a-0be5-440a-8f08-714927380539,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.abb71abb-ed21-46c7-994d-5609b1da4317 1G" returned: 0 in 0.615s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-374bce6d-ef23-47b8-b45a-fa1e562985e1 tempest-VolumesSnapshotListTestJSON-1430186320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.6fc4c35a-0be5-440a-8f08-714927380539 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.abb71abb-ed21-46c7-994d-5609b1da4317 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:42 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98" returned: 0 in 0.460s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.5d4854bc-01b4-4277-8b90-7197c2a1f445 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:42 devstack sudo[100129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.6fc4c35a-0be5-440a-8f08-714927380539 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.abb71abb-ed21-46c7-994d-5609b1da4317 Jul 21 02:16:42 devstack sudo[100129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:42 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.5d4854bc-01b4-4277-8b90-7197c2a1f445 Jul 21 02:16:42 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:42 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8d08c666-62fe-4a51-8f2e-64c668e12b8b tempest-TestStampPattern-361473491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b.6ed3d37a-1c46-45de-bef9-0eeffd11a2e7" returned: 0 in 0.515s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:42 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-8d08c666-62fe-4a51-8f2e-64c668e12b8b tempest-TestStampPattern-361473491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-524d5171-eb4e-4c04-bfff-1f6acf19972b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:16:42 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b95e92-c0b0-433b-a37b-72c15eaf7b8f]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8d08c666-62fe-4a51-8f2e-64c668e12b8b tempest-TestStampPattern-361473491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:42 devstack sudo[100129]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-374bce6d-ef23-47b8-b45a-fa1e562985e1 tempest-VolumesSnapshotListTestJSON-1430186320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.6fc4c35a-0be5-440a-8f08-714927380539 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.abb71abb-ed21-46c7-994d-5609b1da4317" returned: 0 in 0.401s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:42 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-374bce6d-ef23-47b8-b45a-fa1e562985e1 tempest-VolumesSnapshotListTestJSON-1430186320 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.abb71abb-ed21-46c7-994d-5609b1da4317 is being set with open permissions: ugo+rw Jul 21 02:16:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-374bce6d-ef23-47b8-b45a-fa1e562985e1 tempest-VolumesSnapshotListTestJSON-1430186320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.abb71abb-ed21-46c7-994d-5609b1da4317 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:42 devstack sudo[100146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.abb71abb-ed21-46c7-994d-5609b1da4317 Jul 21 02:16:42 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:42 devstack sudo[100142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b Jul 21 02:16:42 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:42 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.5d4854bc-01b4-4277-8b90-7197c2a1f445" returned: 0 in 0.443s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.5d4854bc-01b4-4277-8b90-7197c2a1f445 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:42 devstack sudo[100149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.5d4854bc-01b4-4277-8b90-7197c2a1f445 Jul 21 02:16:42 devstack sudo[100149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:42 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-374bce6d-ef23-47b8-b45a-fa1e562985e1 tempest-VolumesSnapshotListTestJSON-1430186320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.abb71abb-ed21-46c7-994d-5609b1da4317" returned: 0 in 0.327s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:42 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-374bce6d-ef23-47b8-b45a-fa1e562985e1 tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.896s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8d08c666-62fe-4a51-8f2e-64c668e12b8b tempest-TestStampPattern-361473491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b" returned: 0 in 0.473s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8d08c666-62fe-4a51-8f2e-64c668e12b8b tempest-TestStampPattern-361473491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b.6ed3d37a-1c46-45de-bef9-0eeffd11a2e7 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:43 devstack sudo[100156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b.6ed3d37a-1c46-45de-bef9-0eeffd11a2e7 Jul 21 02:16:43 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:43 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-374bce6d-ef23-47b8-b45a-fa1e562985e1 tempest-VolumesSnapshotListTestJSON-1430186320 None] Create snapshot completed successfully Jul 21 02:16:43 devstack sudo[100149]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98.5d4854bc-01b4-4277-8b90-7197c2a1f445" returned: 0 in 0.359s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:43 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-quobyte-5d4854bc-01b4-4277-8b90-7197c2a1f445" released by "_delete_snapshot" :: held 1.900s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:43 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-quobyte-681a1adb-5694-4447-9aef-d55b2da11b98" released by "delete_snapshot" :: held 1.939s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:43 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Created reservations ['d3aa4e6d-1f89-44b2-a00a-ea4b098b87fd', '43f86275-df48-471f-b6ef-e7b133a67827', '9fa792ae-4f02-408b-b815-91fbd2104f6c', 'a77e6146-77f8-4642-801f-178835d03e3e'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:16:43 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Delete snapshot completed successfully. Jul 21 02:16:43 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-5d4854bc-01b4-4277-8b90-7197c2a1f445-delete_snapshot" released by "delete_snapshot" :: held 2.252s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:43 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Snapshots deleted, issuing volume delete {{(pid=87566) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 21 02:16:43 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Acquiring lock "cinder-quobyte-681a1adb-5694-4447-9aef-d55b2da11b98" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:43 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-quobyte-681a1adb-5694-4447-9aef-d55b2da11b98" acquired by "delete_volume" :: waited 0.022s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:43 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[26acb297-fe4b-4096-8611-a82dfac982d9]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:43 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8d08c666-62fe-4a51-8f2e-64c668e12b8b tempest-TestStampPattern-361473491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b.6ed3d37a-1c46-45de-bef9-0eeffd11a2e7" returned: 0 in 0.462s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8d08c666-62fe-4a51-8f2e-64c668e12b8b tempest-TestStampPattern-361473491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b.6ed3d37a-1c46-45de-bef9-0eeffd11a2e7 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:43 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b.6ed3d37a-1c46-45de-bef9-0eeffd11a2e7 Jul 21 02:16:43 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a5a59627-bc18-4f1a-8cb4-d10198ad06c5 tempest-VolumesSnapshotListTestJSON-1430186320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a5a59627-bc18-4f1a-8cb4-d10198ad06c5 tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:43 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-a5a59627-bc18-4f1a-8cb4-d10198ad06c5 tempest-VolumesSnapshotListTestJSON-1430186320 None] Creating offline snapshot 783c9cdc-af28-4ba2-9321-43bb7104fe1e of volume 3a2ea364-4b17-4fcc-b1b6-aa1f5c511515 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:16:43 devstack sudo[100162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98 Jul 21 02:16:43 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:43 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5c0222-c804-4a46-b480-e9d6d1950bc4]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a5a59627-bc18-4f1a-8cb4-d10198ad06c5 tempest-VolumesSnapshotListTestJSON-1430186320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.abb71abb-ed21-46c7-994d-5609b1da4317 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:43 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.abb71abb-ed21-46c7-994d-5609b1da4317 Jul 21 02:16:43 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:43 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8d08c666-62fe-4a51-8f2e-64c668e12b8b tempest-TestStampPattern-361473491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b.6ed3d37a-1c46-45de-bef9-0eeffd11a2e7" returned: 0 in 0.273s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:43 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8d08c666-62fe-4a51-8f2e-64c668e12b8b tempest-TestStampPattern-361473491 None] Lock "cinder-quobyte-6ed3d37a-1c46-45de-bef9-0eeffd11a2e7" released by "_delete_snapshot" :: held 1.856s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:43 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8d08c666-62fe-4a51-8f2e-64c668e12b8b tempest-TestStampPattern-361473491 None] Lock "cinder-quobyte-524d5171-eb4e-4c04-bfff-1f6acf19972b" released by "delete_snapshot" :: held 1.886s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:43 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98" returned: 0 in 0.450s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:43 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-8d08c666-62fe-4a51-8f2e-64c668e12b8b tempest-TestStampPattern-361473491 None] Created reservations ['efebc773-49f7-43fc-a7c4-1f93127c145d', '168bc4b2-29eb-4226-87bf-a6a8e86d42f4', '6c420b94-9c4e-4dc3-bc06-22985a3416c2', '2fc317f8-b1a7-4f5e-99b1-5b3de4b3fcfd'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:16:43 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98 Jul 21 02:16:43 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:43 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-8d08c666-62fe-4a51-8f2e-64c668e12b8b tempest-TestStampPattern-361473491 None] Delete snapshot completed successfully. Jul 21 02:16:43 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8d08c666-62fe-4a51-8f2e-64c668e12b8b tempest-TestStampPattern-361473491 None] Lock "cinder-6ed3d37a-1c46-45de-bef9-0eeffd11a2e7-delete_snapshot" released by "delete_snapshot" :: held 2.062s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:44 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a5a59627-bc18-4f1a-8cb4-d10198ad06c5 tempest-VolumesSnapshotListTestJSON-1430186320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.abb71abb-ed21-46c7-994d-5609b1da4317" returned: 0 in 0.470s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:44 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-a5a59627-bc18-4f1a-8cb4-d10198ad06c5 tempest-VolumesSnapshotListTestJSON-1430186320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:16:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a5a59627-bc18-4f1a-8cb4-d10198ad06c5 tempest-VolumesSnapshotListTestJSON-1430186320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.abb71abb-ed21-46c7-994d-5609b1da4317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.783c9cdc-af28-4ba2-9321-43bb7104fe1e 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:44 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.abb71abb-ed21-46c7-994d-5609b1da4317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.783c9cdc-af28-4ba2-9321-43bb7104fe1e 1G Jul 21 02:16:44 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:44 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-681a1adb-5694-4447-9aef-d55b2da11b98" returned: 0 in 0.336s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:44 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-quobyte-681a1adb-5694-4447-9aef-d55b2da11b98" released by "delete_volume" :: held 0.866s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:44 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Created reservations ['b6567b1f-0630-4d39-813d-0ef6ac57daf1', '1c31178b-2ba4-4654-a2de-5e6e35bcc744', '15c79cd6-4a0c-41cd-9143-1d840a57686a', 'c77fa6c3-c924-4998-b62d-346f5a51d80b'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:16:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:44 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:16:44 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:16:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:44 devstack sudo[100184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:16:44 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:44 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.319s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:44 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:16:44 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Deleted volume successfully. Jul 21 02:16:44 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9d240268-c9e9-42e5-94cf-6dd2eb91f3d3 tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-681a1adb-5694-4447-9aef-d55b2da11b98-delete_volume" released by "delete_volume" :: held 7.919s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:44 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a5a59627-bc18-4f1a-8cb4-d10198ad06c5 tempest-VolumesSnapshotListTestJSON-1430186320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.abb71abb-ed21-46c7-994d-5609b1da4317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.783c9cdc-af28-4ba2-9321-43bb7104fe1e 1G" returned: 0 in 0.683s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a5a59627-bc18-4f1a-8cb4-d10198ad06c5 tempest-VolumesSnapshotListTestJSON-1430186320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.abb71abb-ed21-46c7-994d-5609b1da4317 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.783c9cdc-af28-4ba2-9321-43bb7104fe1e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:44 devstack sudo[100187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.abb71abb-ed21-46c7-994d-5609b1da4317 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.783c9cdc-af28-4ba2-9321-43bb7104fe1e Jul 21 02:16:44 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:45 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a5a59627-bc18-4f1a-8cb4-d10198ad06c5 tempest-VolumesSnapshotListTestJSON-1430186320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.abb71abb-ed21-46c7-994d-5609b1da4317 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.783c9cdc-af28-4ba2-9321-43bb7104fe1e" returned: 0 in 0.462s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:45 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-a5a59627-bc18-4f1a-8cb4-d10198ad06c5 tempest-VolumesSnapshotListTestJSON-1430186320 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.783c9cdc-af28-4ba2-9321-43bb7104fe1e is being set with open permissions: ugo+rw Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a5a59627-bc18-4f1a-8cb4-d10198ad06c5 tempest-VolumesSnapshotListTestJSON-1430186320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.783c9cdc-af28-4ba2-9321-43bb7104fe1e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:45 devstack sudo[100195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.783c9cdc-af28-4ba2-9321-43bb7104fe1e Jul 21 02:16:45 devstack sudo[100195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] Flow 'volume_create_manager' (76b3a892-212c-420a-a7ef-f4d14d0d260f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64cbbb81-4813-4bff-a3d7-17e7dc0cdeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64cbbb81-4813-4bff-a3d7-17e7dc0cdeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1366895549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a354cde4-d813-495a-9c7c-49543d4f2efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f173d9fa753949bc9b9efafd994c7144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:16:45Z,use_quota=True,user_id='797e0fb7eea3495aa86ba65ffd7f9d29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787779a8-569c-4ca9-b3af-66ca95afd009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787779a8-569c-4ca9-b3af-66ca95afd009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31f81542-9324-4518-bcbc-de3e3430ab15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31f81542-9324-4518-bcbc-de3e3430ab15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a354cde4-d813-495a-9c7c-49543d4f2efe', 'volume_name': 'volume-a354cde4-d813-495a-9c7c-49543d4f2efe', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c21d66f4-6fdf-490f-9f9b-4b9809fd7a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:45 devstack sudo[100195]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c21d66f4-6fdf-490f-9f9b-4b9809fd7a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (440f33ee-c855-4b78-a1c8-f1e978ba3b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:45 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] Volume a354cde4-d813-495a-9c7c-49543d4f2efe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a354cde4-d813-495a-9c7c-49543d4f2efe', 'volume_size': 1} Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a5a59627-bc18-4f1a-8cb4-d10198ad06c5 tempest-VolumesSnapshotListTestJSON-1430186320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.783c9cdc-af28-4ba2-9321-43bb7104fe1e" returned: 0 in 0.432s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a5a59627-bc18-4f1a-8cb4-d10198ad06c5 tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.169s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.053s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1366895549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a354cde4-d813-495a-9c7c-49543d4f2efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f173d9fa753949bc9b9efafd994c7144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:16:45Z,use_quota=True,user_id='797e0fb7eea3495aa86ba65ffd7f9d29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] Creating volume a354cde4-d813-495a-9c7c-49543d4f2efe {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:16:45 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a354cde4-d813-495a-9c7c-49543d4f2efe 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:45 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a354cde4-d813-495a-9c7c-49543d4f2efe 1073741824 Jul 21 02:16:45 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] Flow 'volume_create_manager' (dd07ff76-e008-46b0-b18c-1f43e5f451a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55756ce6-a104-47bf-b1aa-8102b68df577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55756ce6-a104-47bf-b1aa-8102b68df577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-107512221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e601611-fe07-4017-82c8-f9b6a6b20d8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a800b1e9dd5841c58107782f5ccafe8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:16:46Z,use_quota=True,user_id='7a26c6494e634984a1386ed89006ec4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f82ab093-3ccc-4931-b499-a0512d0a92db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f82ab093-3ccc-4931-b499-a0512d0a92db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e5baa50-86af-4be8-aede-f0c51fea5666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e5baa50-86af-4be8-aede-f0c51fea5666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e601611-fe07-4017-82c8-f9b6a6b20d8b', 'volume_name': 'volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92b4ec32-fa72-42e6-a590-2e3821eb4f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92b4ec32-fa72-42e6-a590-2e3821eb4f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f42e7ed-02ce-4495-ae7c-eb61f4d5290f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:45 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] Volume 4e601611-fe07-4017-82c8-f9b6a6b20d8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b', 'volume_size': 1} Jul 21 02:16:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:45 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-a5a59627-bc18-4f1a-8cb4-d10198ad06c5 tempest-VolumesSnapshotListTestJSON-1430186320 None] Create snapshot completed successfully Jul 21 02:16:46 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a354cde4-d813-495a-9c7c-49543d4f2efe 1073741824" returned: 0 in 0.620s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a354cde4-d813-495a-9c7c-49543d4f2efe {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:46 devstack sudo[100226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a354cde4-d813-495a-9c7c-49543d4f2efe Jul 21 02:16:46 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:46 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a354cde4-d813-495a-9c7c-49543d4f2efe" returned: 0 in 0.304s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:16:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.693s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-107512221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e601611-fe07-4017-82c8-f9b6a6b20d8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a800b1e9dd5841c58107782f5ccafe8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:16:46Z,use_quota=True,user_id='7a26c6494e634984a1386ed89006ec4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:16:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] Creating volume 4e601611-fe07-4017-82c8-f9b6a6b20d8b {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:16:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:16:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:16:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:16:46 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:16:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:46 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b 1073741824 Jul 21 02:16:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (440f33ee-c855-4b78-a1c8-f1e978ba3b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a354cde4-d813-495a-9c7c-49543d4f2efe', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:46 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b9bba6-da2b-4307-8f90-41794b56571d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:46 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] Volume volume-a354cde4-d813-495a-9c7c-49543d4f2efe (a354cde4-d813-495a-9c7c-49543d4f2efe): created successfully Jul 21 02:16:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b9bba6-da2b-4307-8f90-41794b56571d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] Flow 'volume_create_manager' (76b3a892-212c-420a-a7ef-f4d14d0d260f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:16:46 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-ecd3efb1-1761-4fa6-be50-d34ce9ee145f tempest-VolumesMetadataTest-777751954 None] Created volume successfully. Jul 21 02:16:47 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b 1073741824" returned: 0 in 0.634s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:47 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b Jul 21 02:16:47 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-0d718e22-f62d-423b-8abd-9341d464c6df tempest-VolumesSnapshotListTestJSON-1430186320 None] Acquiring lock "cinder-783c9cdc-af28-4ba2-9321-43bb7104fe1e-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-0d718e22-f62d-423b-8abd-9341d464c6df tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "cinder-783c9cdc-af28-4ba2-9321-43bb7104fe1e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:47 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-0d718e22-f62d-423b-8abd-9341d464c6df tempest-VolumesSnapshotListTestJSON-1430186320 None] Acquiring lock "cinder-quobyte-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b" returned: 0 in 0.334s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:47 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:16:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-0d718e22-f62d-423b-8abd-9341d464c6df tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "cinder-quobyte-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-0d718e22-f62d-423b-8abd-9341d464c6df tempest-VolumesSnapshotListTestJSON-1430186320 None] Acquiring lock "cinder-quobyte-783c9cdc-af28-4ba2-9321-43bb7104fe1e" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f42e7ed-02ce-4495-ae7c-eb61f4d5290f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b52f98-dbad-44a3-870c-ac604c2fbd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-0d718e22-f62d-423b-8abd-9341d464c6df tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "cinder-quobyte-783c9cdc-af28-4ba2-9321-43bb7104fe1e" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:47 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-0d718e22-f62d-423b-8abd-9341d464c6df tempest-VolumesSnapshotListTestJSON-1430186320 None] Deleting offline snapshot 783c9cdc-af28-4ba2-9321-43bb7104fe1e of volume 3a2ea364-4b17-4fcc-b1b6-aa1f5c511515 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:16:47 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-0d718e22-f62d-423b-8abd-9341d464c6df tempest-VolumesSnapshotListTestJSON-1430186320 None] snapshot_file for this snap is: volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.783c9cdc-af28-4ba2-9321-43bb7104fe1e {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:16:47 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] Volume volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b (4e601611-fe07-4017-82c8-f9b6a6b20d8b): created successfully Jul 21 02:16:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b52f98-dbad-44a3-870c-ac604c2fbd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] Flow 'volume_create_manager' (dd07ff76-e008-46b0-b18c-1f43e5f451a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:16:47 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[391249bd-ae0d-492a-9436-f26609dfb066]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0d718e22-f62d-423b-8abd-9341d464c6df tempest-VolumesSnapshotListTestJSON-1430186320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.783c9cdc-af28-4ba2-9321-43bb7104fe1e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:47 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-947da87f-5bfd-4dac-a2f6-681da9073cf0 tempest-VolumesDeleteCascade-1628845007 None] Created volume successfully. Jul 21 02:16:47 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.783c9cdc-af28-4ba2-9321-43bb7104fe1e Jul 21 02:16:47 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-449391b3-b69e-48f3-9ee9-de5868f836cc tempest-TestStampPattern-361473491 None] Acquiring lock "cinder-524d5171-eb4e-4c04-bfff-1f6acf19972b-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-449391b3-b69e-48f3-9ee9-de5868f836cc tempest-TestStampPattern-361473491 None] Lock "cinder-524d5171-eb4e-4c04-bfff-1f6acf19972b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-449391b3-b69e-48f3-9ee9-de5868f836cc tempest-TestStampPattern-361473491 None] Acquiring lock "cinder-quobyte-524d5171-eb4e-4c04-bfff-1f6acf19972b" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-449391b3-b69e-48f3-9ee9-de5868f836cc tempest-TestStampPattern-361473491 None] Lock "cinder-quobyte-524d5171-eb4e-4c04-bfff-1f6acf19972b" acquired by "delete_volume" :: waited 0.029s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:48 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-abe592bc-cc13-4a42-9e44-75301598e243 tempest-VolumesMetadataTest-777751954 None] Acquiring lock "cinder-a354cde4-d813-495a-9c7c-49543d4f2efe-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0d718e22-f62d-423b-8abd-9341d464c6df tempest-VolumesSnapshotListTestJSON-1430186320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.783c9cdc-af28-4ba2-9321-43bb7104fe1e" returned: 0 in 0.474s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-0d718e22-f62d-423b-8abd-9341d464c6df tempest-VolumesSnapshotListTestJSON-1430186320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[078eddd0-189a-4384-bd48-ec0077c22ad0]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-449391b3-b69e-48f3-9ee9-de5868f836cc tempest-TestStampPattern-361473491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac6c25f-3bbe-4955-b8b7-45451094417c]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0d718e22-f62d-423b-8abd-9341d464c6df tempest-VolumesSnapshotListTestJSON-1430186320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.abb71abb-ed21-46c7-994d-5609b1da4317 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-abe592bc-cc13-4a42-9e44-75301598e243 tempest-VolumesMetadataTest-777751954 None] Lock "cinder-a354cde4-d813-495a-9c7c-49543d4f2efe-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-abe592bc-cc13-4a42-9e44-75301598e243 tempest-VolumesMetadataTest-777751954 None] Acquiring lock "cinder-quobyte-a354cde4-d813-495a-9c7c-49543d4f2efe" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-abe592bc-cc13-4a42-9e44-75301598e243 tempest-VolumesMetadataTest-777751954 None] Lock "cinder-quobyte-a354cde4-d813-495a-9c7c-49543d4f2efe" acquired by "delete_volume" :: waited 0.016s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[a429eb32-a462-4e10-a197-88cc3af7d48b]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-abe592bc-cc13-4a42-9e44-75301598e243 tempest-VolumesMetadataTest-777751954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a354cde4-d813-495a-9c7c-49543d4f2efe {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:48 devstack sudo[100246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b Jul 21 02:16:48 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:48 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.abb71abb-ed21-46c7-994d-5609b1da4317 Jul 21 02:16:48 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:48 devstack sudo[100249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a354cde4-d813-495a-9c7c-49543d4f2efe Jul 21 02:16:48 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:48 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-449391b3-b69e-48f3-9ee9-de5868f836cc tempest-TestStampPattern-361473491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b" returned: 0 in 0.394s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-449391b3-b69e-48f3-9ee9-de5868f836cc tempest-TestStampPattern-361473491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:48 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0d718e22-f62d-423b-8abd-9341d464c6df tempest-VolumesSnapshotListTestJSON-1430186320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.abb71abb-ed21-46c7-994d-5609b1da4317" returned: 0 in 0.396s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-0d718e22-f62d-423b-8abd-9341d464c6df tempest-VolumesSnapshotListTestJSON-1430186320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0d718e22-f62d-423b-8abd-9341d464c6df tempest-VolumesSnapshotListTestJSON-1430186320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.783c9cdc-af28-4ba2-9321-43bb7104fe1e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:48 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b Jul 21 02:16:48 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:48 devstack sudo[100259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.783c9cdc-af28-4ba2-9321-43bb7104fe1e Jul 21 02:16:48 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d7f5fe10-5ad5-47c2-9799-55244495d82f tempest-VolumesDeleteCascade-1628845007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d7f5fe10-5ad5-47c2-9799-55244495d82f tempest-VolumesDeleteCascade-1628845007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:48 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-abe592bc-cc13-4a42-9e44-75301598e243 tempest-VolumesMetadataTest-777751954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a354cde4-d813-495a-9c7c-49543d4f2efe" returned: 0 in 0.443s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-abe592bc-cc13-4a42-9e44-75301598e243 tempest-VolumesMetadataTest-777751954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a354cde4-d813-495a-9c7c-49543d4f2efe {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-d7f5fe10-5ad5-47c2-9799-55244495d82f tempest-VolumesDeleteCascade-1628845007 None] Creating offline snapshot d1c1e354-b14f-4063-926a-068db51a51d3 of volume 4e601611-fe07-4017-82c8-f9b6a6b20d8b {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:16:48 devstack sudo[100265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a354cde4-d813-495a-9c7c-49543d4f2efe Jul 21 02:16:48 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db83a5b-d833-478b-9120-518e212ca34b]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d7f5fe10-5ad5-47c2-9799-55244495d82f tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:48 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:16:48 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:48 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-449391b3-b69e-48f3-9ee9-de5868f836cc tempest-TestStampPattern-361473491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-524d5171-eb4e-4c04-bfff-1f6acf19972b" returned: 0 in 0.330s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-449391b3-b69e-48f3-9ee9-de5868f836cc tempest-TestStampPattern-361473491 None] Lock "cinder-quobyte-524d5171-eb4e-4c04-bfff-1f6acf19972b" released by "delete_volume" :: held 0.814s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:49 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b Jul 21 02:16:49 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-449391b3-b69e-48f3-9ee9-de5868f836cc tempest-TestStampPattern-361473491 None] Created reservations ['2a9798a9-3e49-48f3-b9d2-4a45c93487f2', '4cfe1fe0-1904-407f-b0cd-265b873d21f7', '83fe2fe5-6c9c-464c-a8b3-6c790e09a842', '2801f388-915b-496b-86f7-e6a1e9282362'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:16:49 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-abe592bc-cc13-4a42-9e44-75301598e243 tempest-VolumesMetadataTest-777751954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a354cde4-d813-495a-9c7c-49543d4f2efe" returned: 0 in 0.337s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-abe592bc-cc13-4a42-9e44-75301598e243 tempest-VolumesMetadataTest-777751954 None] Lock "cinder-quobyte-a354cde4-d813-495a-9c7c-49543d4f2efe" released by "delete_volume" :: held 0.829s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-449391b3-b69e-48f3-9ee9-de5868f836cc tempest-TestStampPattern-361473491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-449391b3-b69e-48f3-9ee9-de5868f836cc tempest-TestStampPattern-361473491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-449391b3-b69e-48f3-9ee9-de5868f836cc tempest-TestStampPattern-361473491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:16:49 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-449391b3-b69e-48f3-9ee9-de5868f836cc tempest-TestStampPattern-361473491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-449391b3-b69e-48f3-9ee9-de5868f836cc tempest-TestStampPattern-361473491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-449391b3-b69e-48f3-9ee9-de5868f836cc tempest-TestStampPattern-361473491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.335s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager._thread_info {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread count: 28 {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread info: [<_MainThread(MainThread, started 135786703114368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 02:16:49 devstack sudo[100277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:16:49 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:49 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0d718e22-f62d-423b-8abd-9341d464c6df tempest-VolumesSnapshotListTestJSON-1430186320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.783c9cdc-af28-4ba2-9321-43bb7104fe1e" returned: 0 in 0.586s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0d718e22-f62d-423b-8abd-9341d464c6df tempest-VolumesSnapshotListTestJSON-1430186320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.783c9cdc-af28-4ba2-9321-43bb7104fe1e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-abe592bc-cc13-4a42-9e44-75301598e243 tempest-VolumesMetadataTest-777751954 None] Created reservations ['9595045b-4507-4e7e-a65d-7df9773a6c99', '53d012b2-697b-40e1-8c80-fb360096ccd5', '0ff26b30-fa62-4110-b752-cf73f4532a6a', '3e1edec1-4cfc-4b83-aef8-9fd02a0af393'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:16:49 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.783c9cdc-af28-4ba2-9321-43bb7104fe1e Jul 21 02:16:49 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-abe592bc-cc13-4a42-9e44-75301598e243 tempest-VolumesMetadataTest-777751954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-abe592bc-cc13-4a42-9e44-75301598e243 tempest-VolumesMetadataTest-777751954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:49 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-abe592bc-cc13-4a42-9e44-75301598e243 tempest-VolumesMetadataTest-777751954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-abe592bc-cc13-4a42-9e44-75301598e243 tempest-VolumesMetadataTest-777751954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-abe592bc-cc13-4a42-9e44-75301598e243 tempest-VolumesMetadataTest-777751954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-abe592bc-cc13-4a42-9e44-75301598e243 tempest-VolumesMetadataTest-777751954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d7f5fe10-5ad5-47c2-9799-55244495d82f tempest-VolumesDeleteCascade-1628845007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b" returned: 0 in 0.573s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d7f5fe10-5ad5-47c2-9799-55244495d82f tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b.d1c1e354-b14f-4063-926a-068db51a51d3 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:49 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:16:49 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:49 devstack sudo[100286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b.d1c1e354-b14f-4063-926a-068db51a51d3 1G Jul 21 02:16:49 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:49 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-449391b3-b69e-48f3-9ee9-de5868f836cc tempest-TestStampPattern-361473491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.340s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-449391b3-b69e-48f3-9ee9-de5868f836cc tempest-TestStampPattern-361473491 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:16:49 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-449391b3-b69e-48f3-9ee9-de5868f836cc tempest-TestStampPattern-361473491 None] Deleted volume successfully. Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-449391b3-b69e-48f3-9ee9-de5868f836cc tempest-TestStampPattern-361473491 None] Lock "cinder-524d5171-eb4e-4c04-bfff-1f6acf19972b-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:49 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0d718e22-f62d-423b-8abd-9341d464c6df tempest-VolumesSnapshotListTestJSON-1430186320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.783c9cdc-af28-4ba2-9321-43bb7104fe1e" returned: 0 in 0.385s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-0d718e22-f62d-423b-8abd-9341d464c6df tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "cinder-quobyte-783c9cdc-af28-4ba2-9321-43bb7104fe1e" released by "_delete_snapshot" :: held 1.969s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-0d718e22-f62d-423b-8abd-9341d464c6df tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "cinder-quobyte-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515" released by "delete_snapshot" :: held 2.014s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-0d718e22-f62d-423b-8abd-9341d464c6df tempest-VolumesSnapshotListTestJSON-1430186320 None] Created reservations ['3558ff08-7e88-4553-97de-3be05f1721bd', '3abc37fc-f67f-4943-94cc-87dc96505a48', '2477796e-d98b-4de0-9586-a4b82976c187', '764f10e5-15bd-492c-b65f-b42d32db9800'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:16:49 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-abe592bc-cc13-4a42-9e44-75301598e243 tempest-VolumesMetadataTest-777751954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.384s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-abe592bc-cc13-4a42-9e44-75301598e243 tempest-VolumesMetadataTest-777751954 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:16:49 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-abe592bc-cc13-4a42-9e44-75301598e243 tempest-VolumesMetadataTest-777751954 None] Deleted volume successfully. Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-abe592bc-cc13-4a42-9e44-75301598e243 tempest-VolumesMetadataTest-777751954 None] Lock "cinder-a354cde4-d813-495a-9c7c-49543d4f2efe-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:49 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-0d718e22-f62d-423b-8abd-9341d464c6df tempest-VolumesSnapshotListTestJSON-1430186320 None] Delete snapshot completed successfully. Jul 21 02:16:49 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-0d718e22-f62d-423b-8abd-9341d464c6df tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "cinder-783c9cdc-af28-4ba2-9321-43bb7104fe1e-delete_snapshot" released by "delete_snapshot" :: held 2.240s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:50 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d7f5fe10-5ad5-47c2-9799-55244495d82f tempest-VolumesDeleteCascade-1628845007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b.d1c1e354-b14f-4063-926a-068db51a51d3 1G" returned: 0 in 0.559s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d7f5fe10-5ad5-47c2-9799-55244495d82f tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b.d1c1e354-b14f-4063-926a-068db51a51d3 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:50 devstack sudo[100297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b.d1c1e354-b14f-4063-926a-068db51a51d3 Jul 21 02:16:50 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:50 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d7f5fe10-5ad5-47c2-9799-55244495d82f tempest-VolumesDeleteCascade-1628845007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b.d1c1e354-b14f-4063-926a-068db51a51d3" returned: 0 in 0.287s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:50 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-d7f5fe10-5ad5-47c2-9799-55244495d82f tempest-VolumesDeleteCascade-1628845007 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b.d1c1e354-b14f-4063-926a-068db51a51d3 is being set with open permissions: ugo+rw Jul 21 02:16:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d7f5fe10-5ad5-47c2-9799-55244495d82f tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b.d1c1e354-b14f-4063-926a-068db51a51d3 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:50 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b.d1c1e354-b14f-4063-926a-068db51a51d3 Jul 21 02:16:50 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:50 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d7f5fe10-5ad5-47c2-9799-55244495d82f tempest-VolumesDeleteCascade-1628845007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b.d1c1e354-b14f-4063-926a-068db51a51d3" returned: 0 in 0.250s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d7f5fe10-5ad5-47c2-9799-55244495d82f tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:50 devstack sudo[100307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b.info Jul 21 02:16:50 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:50 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6d058fc9-e511-4577-adc7-8ec3f619253c tempest-VolumesSnapshotListTestJSON-1430186320 None] Acquiring lock "cinder-abb71abb-ed21-46c7-994d-5609b1da4317-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d7f5fe10-5ad5-47c2-9799-55244495d82f tempest-VolumesDeleteCascade-1628845007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b.info" returned: 0 in 0.325s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:50 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-d7f5fe10-5ad5-47c2-9799-55244495d82f tempest-VolumesDeleteCascade-1628845007 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b.info is being set with open permissions: ugo+rw Jul 21 02:16:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d7f5fe10-5ad5-47c2-9799-55244495d82f tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6d058fc9-e511-4577-adc7-8ec3f619253c tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "cinder-abb71abb-ed21-46c7-994d-5609b1da4317-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6d058fc9-e511-4577-adc7-8ec3f619253c tempest-VolumesSnapshotListTestJSON-1430186320 None] Acquiring lock "cinder-quobyte-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:50 devstack sudo[100310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b.info Jul 21 02:16:50 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:51 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6d058fc9-e511-4577-adc7-8ec3f619253c tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "cinder-quobyte-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:51 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6d058fc9-e511-4577-adc7-8ec3f619253c tempest-VolumesSnapshotListTestJSON-1430186320 None] Acquiring lock "cinder-quobyte-abb71abb-ed21-46c7-994d-5609b1da4317" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:51 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6d058fc9-e511-4577-adc7-8ec3f619253c tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "cinder-quobyte-abb71abb-ed21-46c7-994d-5609b1da4317" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:51 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-6d058fc9-e511-4577-adc7-8ec3f619253c tempest-VolumesSnapshotListTestJSON-1430186320 None] Deleting offline snapshot abb71abb-ed21-46c7-994d-5609b1da4317 of volume 3a2ea364-4b17-4fcc-b1b6-aa1f5c511515 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:16:51 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-6d058fc9-e511-4577-adc7-8ec3f619253c tempest-VolumesSnapshotListTestJSON-1430186320 None] snapshot_file for this snap is: volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.abb71abb-ed21-46c7-994d-5609b1da4317 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:16:51 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[23069d50-9ec9-4431-9bf0-44c6062e95ef]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6d058fc9-e511-4577-adc7-8ec3f619253c tempest-VolumesSnapshotListTestJSON-1430186320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.abb71abb-ed21-46c7-994d-5609b1da4317 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:51 devstack sudo[100312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.abb71abb-ed21-46c7-994d-5609b1da4317 Jul 21 02:16:51 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:51 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d7f5fe10-5ad5-47c2-9799-55244495d82f tempest-VolumesDeleteCascade-1628845007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b.info" returned: 0 in 0.347s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d7f5fe10-5ad5-47c2-9799-55244495d82f tempest-VolumesDeleteCascade-1628845007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.481s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:51 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-d7f5fe10-5ad5-47c2-9799-55244495d82f tempest-VolumesDeleteCascade-1628845007 None] Create snapshot completed successfully Jul 21 02:16:51 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6d058fc9-e511-4577-adc7-8ec3f619253c tempest-VolumesSnapshotListTestJSON-1430186320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.abb71abb-ed21-46c7-994d-5609b1da4317" returned: 0 in 0.445s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:51 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-6d058fc9-e511-4577-adc7-8ec3f619253c tempest-VolumesSnapshotListTestJSON-1430186320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:16:51 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08bca25-96a3-4f36-94fe-4489f7b36de8]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6d058fc9-e511-4577-adc7-8ec3f619253c tempest-VolumesSnapshotListTestJSON-1430186320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.6fc4c35a-0be5-440a-8f08-714927380539 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:51 devstack sudo[100319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.6fc4c35a-0be5-440a-8f08-714927380539 Jul 21 02:16:51 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:52 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6d058fc9-e511-4577-adc7-8ec3f619253c tempest-VolumesSnapshotListTestJSON-1430186320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.6fc4c35a-0be5-440a-8f08-714927380539" returned: 0 in 0.465s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:52 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-6d058fc9-e511-4577-adc7-8ec3f619253c tempest-VolumesSnapshotListTestJSON-1430186320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:16:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6d058fc9-e511-4577-adc7-8ec3f619253c tempest-VolumesSnapshotListTestJSON-1430186320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.abb71abb-ed21-46c7-994d-5609b1da4317 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:52 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.abb71abb-ed21-46c7-994d-5609b1da4317 Jul 21 02:16:52 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:52 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6d058fc9-e511-4577-adc7-8ec3f619253c tempest-VolumesSnapshotListTestJSON-1430186320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.abb71abb-ed21-46c7-994d-5609b1da4317" returned: 0 in 0.603s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6d058fc9-e511-4577-adc7-8ec3f619253c tempest-VolumesSnapshotListTestJSON-1430186320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.abb71abb-ed21-46c7-994d-5609b1da4317 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:52 devstack sudo[100346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.abb71abb-ed21-46c7-994d-5609b1da4317 Jul 21 02:16:52 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:52 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:16:52 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Flow 'volume_create_manager' (36c0ebe2-067e-494b-a5d1-43d4ff418140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:16:52 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a46d189-4b67-4e00-b989-ca3d5bdd7fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:52 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a46d189-4b67-4e00-b989-ca3d5bdd7fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1604443431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b52171f7-a186-4842-9d28-70c68fc660ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a800b1e9dd5841c58107782f5ccafe8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d1c1e354-b14f-4063-926a-068db51a51d3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:16:53Z,use_quota=True,user_id='7a26c6494e634984a1386ed89006ec4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:52 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78dc2690-187b-4693-9527-7d7c54898a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:52 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78dc2690-187b-4693-9527-7d7c54898a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:52 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2253033-e74c-484f-b655-d895c6ef181e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:52 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2253033-e74c-484f-b655-d895c6ef181e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b52171f7-a186-4842-9d28-70c68fc660ad', 'volume_name': 'volume-b52171f7-a186-4842-9d28-70c68fc660ad', 'volume_size': 1, 'snapshot_id': 'd1c1e354-b14f-4063-926a-068db51a51d3'}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:52 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a9e294-9e6e-49bf-b1d3-fb3c48acbced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:52 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a9e294-9e6e-49bf-b1d3-fb3c48acbced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:52 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9526592c-d49d-4f82-8e22-41afd191c2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:52 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Volume b52171f7-a186-4842-9d28-70c68fc660ad: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b52171f7-a186-4842-9d28-70c68fc660ad', 'volume_size': 1, 'snapshot_id': 'd1c1e354-b14f-4063-926a-068db51a51d3'} Jul 21 02:16:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:52 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Acquiring lock "cinder-quobyte-d1c1e354-b14f-4063-926a-068db51a51d3-b52171f7-a186-4842-9d28-70c68fc660ad" by "_create_volume_from_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:53 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-quobyte-d1c1e354-b14f-4063-926a-068db51a51d3-b52171f7-a186-4842-9d28-70c68fc660ad" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Creating volume b52171f7-a186-4842-9d28-70c68fc660ad from snapshot d1c1e354-b14f-4063-926a-068db51a51d3 {{(pid=87566) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 02:16:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:16:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:16:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:16:53 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Acquiring lock "cinder-quobyte-b52171f7-a186-4842-9d28-70c68fc660ad" by "_copy_volume_from_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:53 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-quobyte-b52171f7-a186-4842-9d28-70c68fc660ad" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] snapshot: d1c1e354-b14f-4063-926a-068db51a51d3, volume: b52171f7-a186-4842-9d28-70c68fc660ad, {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 02:16:53 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:16:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:16:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:16:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:16:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:16:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6d058fc9-e511-4577-adc7-8ec3f619253c tempest-VolumesSnapshotListTestJSON-1430186320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.abb71abb-ed21-46c7-994d-5609b1da4317" returned: 0 in 0.551s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:53 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e72fa7-1585-45cd-9584-a227ebd0056c]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b.d1c1e354-b14f-4063-926a-068db51a51d3 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:53 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6d058fc9-e511-4577-adc7-8ec3f619253c tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "cinder-quobyte-abb71abb-ed21-46c7-994d-5609b1da4317" released by "_delete_snapshot" :: held 2.270s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:53 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6d058fc9-e511-4577-adc7-8ec3f619253c tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "cinder-quobyte-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515" released by "delete_snapshot" :: held 2.306s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:53 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-6d058fc9-e511-4577-adc7-8ec3f619253c tempest-VolumesSnapshotListTestJSON-1430186320 None] Created reservations ['8072f6bd-4bdc-4491-9a86-8a9a202ad56d', '3e7d4cc4-44fa-4c28-ba26-0e9af1b2213f', 'eeade48d-4e04-4b15-90e7-6cfe7dac037a', '89d05494-66a7-4e86-98c4-58fec5cd28b7'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:16:53 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b.d1c1e354-b14f-4063-926a-068db51a51d3 Jul 21 02:16:53 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:53 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-6d058fc9-e511-4577-adc7-8ec3f619253c tempest-VolumesSnapshotListTestJSON-1430186320 None] Delete snapshot completed successfully. Jul 21 02:16:53 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6d058fc9-e511-4577-adc7-8ec3f619253c tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "cinder-abb71abb-ed21-46c7-994d-5609b1da4317-delete_snapshot" released by "delete_snapshot" :: held 2.525s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:53 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b.d1c1e354-b14f-4063-926a-068db51a51d3" returned: 0 in 0.491s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:16:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 02:16:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Creating direct copy from snapshot {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 02:16:53 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a86877e-5dd4-41a9-a4c1-4a5f899cff48]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:53 devstack sudo[100376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b Jul 21 02:16:53 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-fdc6b7ed-b112-44c4-b3f7-c5a9f646b38e tempest-VolumesSnapshotListTestJSON-1430186320 None] Acquiring lock "cinder-6fc4c35a-0be5-440a-8f08-714927380539-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:54 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b" returned: 0 in 0.530s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:54 devstack cinder-volume[87566]: DEBUG cinder.utils [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Path /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b52171f7-a186-4842-9d28-70c68fc660ad not found in is_blk_device check {{(pid=87566) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 02:16:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b52171f7-a186-4842-9d28-70c68fc660ad {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:54 devstack sudo[100383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b52171f7-a186-4842-9d28-70c68fc660ad Jul 21 02:16:54 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-fdc6b7ed-b112-44c4-b3f7-c5a9f646b38e tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "cinder-6fc4c35a-0be5-440a-8f08-714927380539-delete_snapshot" acquired by "delete_snapshot" :: waited 0.074s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-fdc6b7ed-b112-44c4-b3f7-c5a9f646b38e tempest-VolumesSnapshotListTestJSON-1430186320 None] Acquiring lock "cinder-quobyte-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-fdc6b7ed-b112-44c4-b3f7-c5a9f646b38e tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "cinder-quobyte-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-fdc6b7ed-b112-44c4-b3f7-c5a9f646b38e tempest-VolumesSnapshotListTestJSON-1430186320 None] Acquiring lock "cinder-quobyte-6fc4c35a-0be5-440a-8f08-714927380539" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-fdc6b7ed-b112-44c4-b3f7-c5a9f646b38e tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "cinder-quobyte-6fc4c35a-0be5-440a-8f08-714927380539" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:54 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-fdc6b7ed-b112-44c4-b3f7-c5a9f646b38e tempest-VolumesSnapshotListTestJSON-1430186320 None] Deleting offline snapshot 6fc4c35a-0be5-440a-8f08-714927380539 of volume 3a2ea364-4b17-4fcc-b1b6-aa1f5c511515 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:16:54 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-fdc6b7ed-b112-44c4-b3f7-c5a9f646b38e tempest-VolumesSnapshotListTestJSON-1430186320 None] snapshot_file for this snap is: volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.6fc4c35a-0be5-440a-8f08-714927380539 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:16:54 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[c381c261-af95-41b9-83da-4673a32731b8]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fdc6b7ed-b112-44c4-b3f7-c5a9f646b38e tempest-VolumesSnapshotListTestJSON-1430186320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.6fc4c35a-0be5-440a-8f08-714927380539 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:54 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.6fc4c35a-0be5-440a-8f08-714927380539 Jul 21 02:16:54 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:55 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fdc6b7ed-b112-44c4-b3f7-c5a9f646b38e tempest-VolumesSnapshotListTestJSON-1430186320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.6fc4c35a-0be5-440a-8f08-714927380539" returned: 0 in 0.830s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-fdc6b7ed-b112-44c4-b3f7-c5a9f646b38e tempest-VolumesSnapshotListTestJSON-1430186320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:16:55 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[943ea6a9-45a7-4e09-9576-234a3aff3c1c]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fdc6b7ed-b112-44c4-b3f7-c5a9f646b38e tempest-VolumesSnapshotListTestJSON-1430186320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:55 devstack sudo[100400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515 Jul 21 02:16:55 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:56 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fdc6b7ed-b112-44c4-b3f7-c5a9f646b38e tempest-VolumesSnapshotListTestJSON-1430186320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515" returned: 0 in 1.025s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fdc6b7ed-b112-44c4-b3f7-c5a9f646b38e tempest-VolumesSnapshotListTestJSON-1430186320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.6fc4c35a-0be5-440a-8f08-714927380539 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:56 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.6fc4c35a-0be5-440a-8f08-714927380539 Jul 21 02:16:56 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:57 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fdc6b7ed-b112-44c4-b3f7-c5a9f646b38e tempest-VolumesSnapshotListTestJSON-1430186320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.6fc4c35a-0be5-440a-8f08-714927380539" returned: 0 in 1.133s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fdc6b7ed-b112-44c4-b3f7-c5a9f646b38e tempest-VolumesSnapshotListTestJSON-1430186320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.6fc4c35a-0be5-440a-8f08-714927380539 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:57 devstack sudo[100413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.6fc4c35a-0be5-440a-8f08-714927380539 Jul 21 02:16:57 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:58 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root Jul 21 02:16:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fdc6b7ed-b112-44c4-b3f7-c5a9f646b38e tempest-VolumesSnapshotListTestJSON-1430186320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515.6fc4c35a-0be5-440a-8f08-714927380539" returned: 0 in 0.489s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:16:58 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-fdc6b7ed-b112-44c4-b3f7-c5a9f646b38e tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "cinder-quobyte-6fc4c35a-0be5-440a-8f08-714927380539" released by "_delete_snapshot" :: held 3.767s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:58 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-fdc6b7ed-b112-44c4-b3f7-c5a9f646b38e tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "cinder-quobyte-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515" released by "delete_snapshot" :: held 3.823s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:58 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-fdc6b7ed-b112-44c4-b3f7-c5a9f646b38e tempest-VolumesSnapshotListTestJSON-1430186320 None] Created reservations ['46341778-d2a2-4670-8e7e-3ff708b308da', '74ca3f01-1c59-451d-b5f0-45c8f7e28d86', '67b2deb7-64e9-4661-8ea2-6d884ad66083', '635cfe51-7641-4abf-b40d-95a3025ece4c'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:16:58 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-fdc6b7ed-b112-44c4-b3f7-c5a9f646b38e tempest-VolumesSnapshotListTestJSON-1430186320 None] Delete snapshot completed successfully. Jul 21 02:16:58 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-fdc6b7ed-b112-44c4-b3f7-c5a9f646b38e tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "cinder-6fc4c35a-0be5-440a-8f08-714927380539-delete_snapshot" released by "delete_snapshot" :: held 4.265s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:16:58 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e82723d1-fa82-4b4c-a2c1-72e1771b8b1d tempest-VolumesSnapshotListTestJSON-1430186320 None] Acquiring lock "cinder-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:59 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e82723d1-fa82-4b4c-a2c1-72e1771b8b1d tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "cinder-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:59 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e82723d1-fa82-4b4c-a2c1-72e1771b8b1d tempest-VolumesSnapshotListTestJSON-1430186320 None] Acquiring lock "cinder-quobyte-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:16:59 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e82723d1-fa82-4b4c-a2c1-72e1771b8b1d tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "cinder-quobyte-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515" acquired by "delete_volume" :: waited 0.022s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:16:59 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c62d92-bb96-4afb-9f35-a2263d485cba]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:16:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e82723d1-fa82-4b4c-a2c1-72e1771b8b1d tempest-VolumesSnapshotListTestJSON-1430186320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:16:59 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:16:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] Flow 'volume_create_manager' (748af453-52b5-4c00-b64c-849dc7ae2b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:16:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3565ba27-9582-480b-ad24-0b300a5d16b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3565ba27-9582-480b-ad24-0b300a5d16b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-273551372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01f34867-fe87-46af-8696-de5c2f58a7bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d58d4b0371344fe9bdcab12e8f7b982e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:16:59Z,use_quota=True,user_id='21893ccd6f9e4b6794ad3d94839bfb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d7d29f7-d81c-4a81-ac34-fd43b8977d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d7d29f7-d81c-4a81-ac34-fd43b8977d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b37dab2f-74bb-40a7-97d5-07a433462c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:59 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515 Jul 21 02:16:59 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:16:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b37dab2f-74bb-40a7-97d5-07a433462c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01f34867-fe87-46af-8696-de5c2f58a7bb', 'volume_name': 'volume-01f34867-fe87-46af-8696-de5c2f58a7bb', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae15ceb-3b5b-47ea-8376-c5734567471a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae15ceb-3b5b-47ea-8376-c5734567471a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:16:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27851348-346e-4dab-9523-9e94050124b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:16:59 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] Volume 01f34867-fe87-46af-8696-de5c2f58a7bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01f34867-fe87-46af-8696-de5c2f58a7bb', 'volume_size': 1} Jul 21 02:16:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:00 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b52171f7-a186-4842-9d28-70c68fc660ad" returned: 0 in 6.012s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:00 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e82723d1-fa82-4b4c-a2c1-72e1771b8b1d tempest-VolumesSnapshotListTestJSON-1430186320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515" returned: 0 in 0.867s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e82723d1-fa82-4b4c-a2c1-72e1771b8b1d tempest-VolumesSnapshotListTestJSON-1430186320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:00 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f76651-3909-44f1-a09d-3adb28f0d4dc]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:17:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:00 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515 Jul 21 02:17:00 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:00 devstack sudo[100422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b Jul 21 02:17:00 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:00 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e82723d1-fa82-4b4c-a2c1-72e1771b8b1d tempest-VolumesSnapshotListTestJSON-1430186320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515" returned: 0 in 0.313s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:00 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e82723d1-fa82-4b4c-a2c1-72e1771b8b1d tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "cinder-quobyte-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515" released by "delete_volume" :: held 1.525s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:00 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-e82723d1-fa82-4b4c-a2c1-72e1771b8b1d tempest-VolumesSnapshotListTestJSON-1430186320 None] Created reservations ['c3b20769-3ea4-4a95-aa14-04a521be851a', 'a7450f07-3a6a-4e5e-950b-a8861c937c6a', 'bfcb14dc-b206-4074-baa9-2828b9faee86', 'b924136d-0196-4a0b-a857-6826460c8054'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:17:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e82723d1-fa82-4b4c-a2c1-72e1771b8b1d tempest-VolumesSnapshotListTestJSON-1430186320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e82723d1-fa82-4b4c-a2c1-72e1771b8b1d tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:00 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e82723d1-fa82-4b4c-a2c1-72e1771b8b1d tempest-VolumesSnapshotListTestJSON-1430186320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:17:00 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e82723d1-fa82-4b4c-a2c1-72e1771b8b1d tempest-VolumesSnapshotListTestJSON-1430186320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:17:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e82723d1-fa82-4b4c-a2c1-72e1771b8b1d tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e82723d1-fa82-4b4c-a2c1-72e1771b8b1d tempest-VolumesSnapshotListTestJSON-1430186320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:00 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:17:00 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:01 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b" returned: 0 in 0.667s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Image conversion details: src /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b, size 1024.00 MB, duration 6.01 sec, destination /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b52171f7-a186-4842-9d28-70c68fc660ad {{(pid=87566) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 02:17:01 devstack cinder-volume[87566]: INFO cinder.image.image_utils [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Converted 1024.00 MB image at 170.29 MB/s Jul 21 02:17:01 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b52171f7-a186-4842-9d28-70c68fc660ad is being set with open permissions: ugo+rw Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b52171f7-a186-4842-9d28-70c68fc660ad {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:01 devstack sudo[100431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b52171f7-a186-4842-9d28-70c68fc660ad Jul 21 02:17:01 devstack sudo[100431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:01 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e82723d1-fa82-4b4c-a2c1-72e1771b8b1d tempest-VolumesSnapshotListTestJSON-1430186320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.290s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-e82723d1-fa82-4b4c-a2c1-72e1771b8b1d tempest-VolumesSnapshotListTestJSON-1430186320 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:17:01 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-e82723d1-fa82-4b4c-a2c1-72e1771b8b1d tempest-VolumesSnapshotListTestJSON-1430186320 None] Deleted volume successfully. Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e82723d1-fa82-4b4c-a2c1-72e1771b8b1d tempest-VolumesSnapshotListTestJSON-1430186320 None] Lock "cinder-3a2ea364-4b17-4fcc-b1b6-aa1f5c511515-delete_volume" released by "delete_volume" :: held 2.108s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:01 devstack sudo[100431]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b52171f7-a186-4842-9d28-70c68fc660ad" returned: 0 in 0.299s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-quobyte-b52171f7-a186-4842-9d28-70c68fc660ad" released by "_copy_volume_from_snapshot" :: held 8.238s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-quobyte-d1c1e354-b14f-4063-926a-068db51a51d3-b52171f7-a186-4842-9d28-70c68fc660ad" released by "_create_volume_from_snapshot" :: held 8.305s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.337s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.514s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-273551372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01f34867-fe87-46af-8696-de5c2f58a7bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d58d4b0371344fe9bdcab12e8f7b982e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:16:59Z,use_quota=True,user_id='21893ccd6f9e4b6794ad3d94839bfb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] Creating volume 01f34867-fe87-46af-8696-de5c2f58a7bb {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:17:01 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-01f34867-fe87-46af-8696-de5c2f58a7bb 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:01 devstack sudo[100436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-01f34867-fe87-46af-8696-de5c2f58a7bb 1073741824 Jul 21 02:17:01 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9526592c-d49d-4f82-8e22-41afd191c2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b52171f7-a186-4842-9d28-70c68fc660ad', 'volume_size': 1, 'snapshot_id': 'd1c1e354-b14f-4063-926a-068db51a51d3'}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5823365c-f8d0-49e7-a713-7478b6eff35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:01 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Volume volume-b52171f7-a186-4842-9d28-70c68fc660ad (b52171f7-a186-4842-9d28-70c68fc660ad): created successfully Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5823365c-f8d0-49e7-a713-7478b6eff35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Flow 'volume_create_manager' (36c0ebe2-067e-494b-a5d1-43d4ff418140) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:17:01 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-cc56b79c-a5a6-417a-af68-47c5c64780b5 tempest-VolumesDeleteCascade-1628845007 None] Created volume successfully. Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Acquiring lock "cinder-4e601611-fe07-4017-82c8-f9b6a6b20d8b-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-4e601611-fe07-4017-82c8-f9b6a6b20d8b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Performing cascade delete. {{(pid=87566) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Acquiring lock "cinder-d1c1e354-b14f-4063-926a-068db51a51d3-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-d1c1e354-b14f-4063-926a-068db51a51d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Acquiring lock "cinder-quobyte-4e601611-fe07-4017-82c8-f9b6a6b20d8b" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-quobyte-4e601611-fe07-4017-82c8-f9b6a6b20d8b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Acquiring lock "cinder-quobyte-d1c1e354-b14f-4063-926a-068db51a51d3" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-quobyte-d1c1e354-b14f-4063-926a-068db51a51d3" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Deleting offline snapshot d1c1e354-b14f-4063-926a-068db51a51d3 of volume 4e601611-fe07-4017-82c8-f9b6a6b20d8b {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] snapshot_file for this snap is: volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b.d1c1e354-b14f-4063-926a-068db51a51d3 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b5fe13-55a9-4af8-97b6-0613b8420d07]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b.d1c1e354-b14f-4063-926a-068db51a51d3 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:01 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-01f34867-fe87-46af-8696-de5c2f58a7bb 1073741824" returned: 0 in 0.617s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-01f34867-fe87-46af-8696-de5c2f58a7bb {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:02 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-01f34867-fe87-46af-8696-de5c2f58a7bb Jul 21 02:17:02 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:02 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b.d1c1e354-b14f-4063-926a-068db51a51d3 Jul 21 02:17:02 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:02 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-01f34867-fe87-46af-8696-de5c2f58a7bb" returned: 0 in 0.300s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:02 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:17:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:02 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27851348-346e-4dab-9523-9e94050124b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01f34867-fe87-46af-8696-de5c2f58a7bb', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:02 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2da9b575-6684-4645-825b-acd8bc8b1df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:02 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] Volume volume-01f34867-fe87-46af-8696-de5c2f58a7bb (01f34867-fe87-46af-8696-de5c2f58a7bb): created successfully Jul 21 02:17:02 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2da9b575-6684-4645-825b-acd8bc8b1df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:02 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] Flow 'volume_create_manager' (748af453-52b5-4c00-b64c-849dc7ae2b41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:17:02 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-8fc8aebc-32b0-4cfa-b99a-435ceb3aa07d tempest-VolumesTransfersV357Test-1916241121 None] Created volume successfully. Jul 21 02:17:02 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b.d1c1e354-b14f-4063-926a-068db51a51d3" returned: 0 in 0.515s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:02 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:17:02 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be07ea7-4d2e-432a-a70e-c8c934405b47]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:17:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:02 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b Jul 21 02:17:02 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:02 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b" returned: 0 in 0.452s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b.d1c1e354-b14f-4063-926a-068db51a51d3 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:02 devstack sudo[100460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b.d1c1e354-b14f-4063-926a-068db51a51d3 Jul 21 02:17:02 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:03 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b.d1c1e354-b14f-4063-926a-068db51a51d3" returned: 0 in 0.385s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b.d1c1e354-b14f-4063-926a-068db51a51d3 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:03 devstack sudo[100466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b.d1c1e354-b14f-4063-926a-068db51a51d3 Jul 21 02:17:03 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:03 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b.d1c1e354-b14f-4063-926a-068db51a51d3" returned: 0 in 0.361s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-quobyte-d1c1e354-b14f-4063-926a-068db51a51d3" released by "_delete_snapshot" :: held 1.831s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-quobyte-4e601611-fe07-4017-82c8-f9b6a6b20d8b" released by "delete_snapshot" :: held 1.860s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:03 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Created reservations ['c40821de-81e5-4453-a5f9-40eafdaf9c91', '40e0db1b-c5fc-4d11-953b-0b6a3eccc857', '8e5916fc-814b-4831-99da-7e60b2a5723c', '3c07d543-8b24-472d-90a3-ac84a1345eac'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:17:03 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Delete snapshot completed successfully. Jul 21 02:17:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-d1c1e354-b14f-4063-926a-068db51a51d3-delete_snapshot" released by "delete_snapshot" :: held 2.041s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:03 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Snapshots deleted, issuing volume delete {{(pid=87566) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 21 02:17:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Acquiring lock "cinder-quobyte-4e601611-fe07-4017-82c8-f9b6a6b20d8b" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-quobyte-4e601611-fe07-4017-82c8-f9b6a6b20d8b" acquired by "delete_volume" :: waited 0.013s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:03 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4df8f7f-9ec1-4cb8-9e87-6e70bd401beb]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:17:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:04 devstack sudo[100469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b Jul 21 02:17:04 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:04 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b" returned: 0 in 0.438s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:04 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b Jul 21 02:17:04 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:04 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-f129fe2e-a020-4bd3-ad81-192f8d363f2f tempest-VolumesTransfersV357Test-709658847 None] Transfer volume completed successfully. Jul 21 02:17:04 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4e601611-fe07-4017-82c8-f9b6a6b20d8b" returned: 0 in 0.324s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:04 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-quobyte-4e601611-fe07-4017-82c8-f9b6a6b20d8b" released by "delete_volume" :: held 0.865s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:04 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Created reservations ['14171d0e-94f6-4ebb-8366-f9aa27f15df4', '2d8f4f21-193b-4554-ba42-b59495b83f80', 'c8c8658f-14e5-441e-8656-9e447b2ef9e3', '619b07b8-a360-49c1-9fe3-40ce1b7a4a17'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:17:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:04 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:17:04 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:17:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:04 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:17:04 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:05 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.288s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:17:05 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Deleted volume successfully. Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-16fbea98-53b2-422b-8394-fce4f8251fe6 tempest-VolumesTransfersV357Test-1054355940 None] Acquiring lock "cinder-01f34867-fe87-46af-8696-de5c2f58a7bb-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d7318f5b-5c8a-48c1-a2cb-605fdfc88792 tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-4e601611-fe07-4017-82c8-f9b6a6b20d8b-delete_volume" released by "delete_volume" :: held 3.510s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-16fbea98-53b2-422b-8394-fce4f8251fe6 tempest-VolumesTransfersV357Test-1054355940 None] Lock "cinder-01f34867-fe87-46af-8696-de5c2f58a7bb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-16fbea98-53b2-422b-8394-fce4f8251fe6 tempest-VolumesTransfersV357Test-1054355940 None] Acquiring lock "cinder-quobyte-01f34867-fe87-46af-8696-de5c2f58a7bb" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-16fbea98-53b2-422b-8394-fce4f8251fe6 tempest-VolumesTransfersV357Test-1054355940 None] Lock "cinder-quobyte-01f34867-fe87-46af-8696-de5c2f58a7bb" acquired by "delete_volume" :: waited 0.015s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6132a7-8930-40cf-b980-d67351b8752b]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-16fbea98-53b2-422b-8394-fce4f8251fe6 tempest-VolumesTransfersV357Test-1054355940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-01f34867-fe87-46af-8696-de5c2f58a7bb {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:05 devstack sudo[100487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-01f34867-fe87-46af-8696-de5c2f58a7bb Jul 21 02:17:05 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4d19f3f6-7e34-4d40-b9ac-3aa1803385fc tempest-VolumesDeleteCascade-1628845007 None] Acquiring lock "cinder-b52171f7-a186-4842-9d28-70c68fc660ad-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4d19f3f6-7e34-4d40-b9ac-3aa1803385fc tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-b52171f7-a186-4842-9d28-70c68fc660ad-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4d19f3f6-7e34-4d40-b9ac-3aa1803385fc tempest-VolumesDeleteCascade-1628845007 None] Acquiring lock "cinder-quobyte-b52171f7-a186-4842-9d28-70c68fc660ad" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4d19f3f6-7e34-4d40-b9ac-3aa1803385fc tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-quobyte-b52171f7-a186-4842-9d28-70c68fc660ad" acquired by "delete_volume" :: waited 0.016s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cc3946-7723-4dae-b445-b3bcc8ecbb2a]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4d19f3f6-7e34-4d40-b9ac-3aa1803385fc tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b52171f7-a186-4842-9d28-70c68fc660ad {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:17:05 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Flow 'volume_create_manager' (516cb1e0-fdb4-4157-afcc-bdf47a125c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f9fc82-949f-46ab-84ad-0b808c731d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-16fbea98-53b2-422b-8394-fce4f8251fe6 tempest-VolumesTransfersV357Test-1054355940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-01f34867-fe87-46af-8696-de5c2f58a7bb" returned: 0 in 0.516s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-16fbea98-53b2-422b-8394-fce4f8251fe6 tempest-VolumesTransfersV357Test-1054355940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-01f34867-fe87-46af-8696-de5c2f58a7bb {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f9fc82-949f-46ab-84ad-0b808c731d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-719780918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff3e0b8-eeff-4951-b76e-88fc8875fc31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c387144ab3b6448c8c5fb3bf3080c9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:17:06Z,use_quota=True,user_id='47229f2f1f3440e28f34d14fa0d3657a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:05 devstack sudo[100494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-01f34867-fe87-46af-8696-de5c2f58a7bb Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d451130-8b1d-44a0-9e90-a3c1598ff615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:05 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d451130-8b1d-44a0-9e90-a3c1598ff615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd9dad8d-795a-4873-b005-203cb8984232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:05 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b52171f7-a186-4842-9d28-70c68fc660ad Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd9dad8d-795a-4873-b005-203cb8984232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ff3e0b8-eeff-4951-b76e-88fc8875fc31', 'volume_name': 'volume-7ff3e0b8-eeff-4951-b76e-88fc8875fc31', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:05 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c457ad8f-f005-4125-adc9-aabac893660d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c457ad8f-f005-4125-adc9-aabac893660d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03c2d7d8-24df-4a1f-88b1-7e02a7eecb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:05 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Volume 7ff3e0b8-eeff-4951-b76e-88fc8875fc31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ff3e0b8-eeff-4951-b76e-88fc8875fc31', 'volume_size': 1} Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-719780918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff3e0b8-eeff-4951-b76e-88fc8875fc31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c387144ab3b6448c8c5fb3bf3080c9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:17:06Z,use_quota=True,user_id='47229f2f1f3440e28f34d14fa0d3657a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Creating volume 7ff3e0b8-eeff-4951-b76e-88fc8875fc31 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:17:05 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:17:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7ff3e0b8-eeff-4951-b76e-88fc8875fc31 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:06 devstack sudo[100497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7ff3e0b8-eeff-4951-b76e-88fc8875fc31 1073741824 Jul 21 02:17:06 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Flow 'volume_create_manager' (0c898518-3bdb-422c-b833-1c0a30b84eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:17:06 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7286f370-bf41-4cfc-bd18-5e6ce0379247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-16fbea98-53b2-422b-8394-fce4f8251fe6 tempest-VolumesTransfersV357Test-1054355940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-01f34867-fe87-46af-8696-de5c2f58a7bb" returned: 0 in 0.327s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7286f370-bf41-4cfc-bd18-5e6ce0379247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-910392450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f876b084-2f8b-47f1-9e55-c54672981211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4df8cc6e554107a8d9362a1b7c54e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:17:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:17:06Z,use_quota=True,user_id='4bc690b6c6ad4965bcc04fd244114411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4058009-6672-4b61-994e-7a0a7518a0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4058009-6672-4b61-994e-7a0a7518a0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55585c6f-049a-45ac-a076-f4ac7f888fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55585c6f-049a-45ac-a076-f4ac7f888fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f876b084-2f8b-47f1-9e55-c54672981211', 'volume_name': 'volume-f876b084-2f8b-47f1-9e55-c54672981211', 'volume_size': 2}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e3beede-2ae7-4a97-8e9f-53793249828e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e3beede-2ae7-4a97-8e9f-53793249828e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (584737b0-f706-4843-8fc8-7f4f42569792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:06 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Volume f876b084-2f8b-47f1-9e55-c54672981211: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f876b084-2f8b-47f1-9e55-c54672981211', 'volume_size': 2} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-16fbea98-53b2-422b-8394-fce4f8251fe6 tempest-VolumesTransfersV357Test-1054355940 None] Lock "cinder-quobyte-01f34867-fe87-46af-8696-de5c2f58a7bb" released by "delete_volume" :: held 0.941s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:06 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4d19f3f6-7e34-4d40-b9ac-3aa1803385fc tempest-VolumesDeleteCascade-1628845007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b52171f7-a186-4842-9d28-70c68fc660ad" returned: 0 in 0.534s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4d19f3f6-7e34-4d40-b9ac-3aa1803385fc tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b52171f7-a186-4842-9d28-70c68fc660ad {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:06 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b52171f7-a186-4842-9d28-70c68fc660ad Jul 21 02:17:06 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-16fbea98-53b2-422b-8394-fce4f8251fe6 tempest-VolumesTransfersV357Test-1054355940 None] Created reservations ['27e2b75b-4e09-4d6d-a66d-8a09edb3707c', 'f16c5ceb-ef88-4954-8786-da8ab1a7356b', 'cfac7da2-514b-4ce2-99d4-67d8eeeb90bc', '2beb40ed-2d7e-4d5b-af20-1062393368f4'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-16fbea98-53b2-422b-8394-fce4f8251fe6 tempest-VolumesTransfersV357Test-1054355940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-16fbea98-53b2-422b-8394-fce4f8251fe6 tempest-VolumesTransfersV357Test-1054355940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-16fbea98-53b2-422b-8394-fce4f8251fe6 tempest-VolumesTransfersV357Test-1054355940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-16fbea98-53b2-422b-8394-fce4f8251fe6 tempest-VolumesTransfersV357Test-1054355940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-16fbea98-53b2-422b-8394-fce4f8251fe6 tempest-VolumesTransfersV357Test-1054355940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-16fbea98-53b2-422b-8394-fce4f8251fe6 tempest-VolumesTransfersV357Test-1054355940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:06 devstack sudo[100509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:17:06 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:06 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7ff3e0b8-eeff-4951-b76e-88fc8875fc31 1073741824" returned: 0 in 0.517s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7ff3e0b8-eeff-4951-b76e-88fc8875fc31 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:06 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7ff3e0b8-eeff-4951-b76e-88fc8875fc31 Jul 21 02:17:06 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:06 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4d19f3f6-7e34-4d40-b9ac-3aa1803385fc tempest-VolumesDeleteCascade-1628845007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b52171f7-a186-4842-9d28-70c68fc660ad" returned: 0 in 0.309s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4d19f3f6-7e34-4d40-b9ac-3aa1803385fc tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-quobyte-b52171f7-a186-4842-9d28-70c68fc660ad" released by "delete_volume" :: held 0.908s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-4d19f3f6-7e34-4d40-b9ac-3aa1803385fc tempest-VolumesDeleteCascade-1628845007 None] Created reservations ['276593b8-02a0-404b-b220-983407c57cb8', 'ef197d7c-6066-4bf7-8689-e9d54ce5f8a2', 'c668f06b-26f1-4764-89ca-4c2b7e2bdc95', '4afeedfd-484a-457b-8080-26549b6be348'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:17:06 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-16fbea98-53b2-422b-8394-fce4f8251fe6 tempest-VolumesTransfersV357Test-1054355940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.307s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-16fbea98-53b2-422b-8394-fce4f8251fe6 tempest-VolumesTransfersV357Test-1054355940 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:17:06 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-16fbea98-53b2-422b-8394-fce4f8251fe6 tempest-VolumesTransfersV357Test-1054355940 None] Deleted volume successfully. Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-16fbea98-53b2-422b-8394-fce4f8251fe6 tempest-VolumesTransfersV357Test-1054355940 None] Lock "cinder-01f34867-fe87-46af-8696-de5c2f58a7bb-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4d19f3f6-7e34-4d40-b9ac-3aa1803385fc tempest-VolumesDeleteCascade-1628845007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4d19f3f6-7e34-4d40-b9ac-3aa1803385fc tempest-VolumesDeleteCascade-1628845007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4d19f3f6-7e34-4d40-b9ac-3aa1803385fc tempest-VolumesDeleteCascade-1628845007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4d19f3f6-7e34-4d40-b9ac-3aa1803385fc tempest-VolumesDeleteCascade-1628845007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4d19f3f6-7e34-4d40-b9ac-3aa1803385fc tempest-VolumesDeleteCascade-1628845007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4d19f3f6-7e34-4d40-b9ac-3aa1803385fc tempest-VolumesDeleteCascade-1628845007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:06 devstack sudo[100515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:17:06 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:06 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7ff3e0b8-eeff-4951-b76e-88fc8875fc31" returned: 0 in 0.322s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.606s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-910392450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f876b084-2f8b-47f1-9e55-c54672981211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4df8cc6e554107a8d9362a1b7c54e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:17:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:17:06Z,use_quota=True,user_id='4bc690b6c6ad4965bcc04fd244114411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Creating volume f876b084-2f8b-47f1-9e55-c54672981211 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:17:06 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211 2147483648 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:06 devstack sudo[100518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211 2147483648 Jul 21 02:17:06 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03c2d7d8-24df-4a1f-88b1-7e02a7eecb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ff3e0b8-eeff-4951-b76e-88fc8875fc31', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa67a0a6-bcf6-4f2d-92aa-3f0110d16331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:06 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Volume volume-7ff3e0b8-eeff-4951-b76e-88fc8875fc31 (7ff3e0b8-eeff-4951-b76e-88fc8875fc31): created successfully Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa67a0a6-bcf6-4f2d-92aa-3f0110d16331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Flow 'volume_create_manager' (516cb1e0-fdb4-4157-afcc-bdf47a125c96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:17:07 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-89e4f7c8-6864-441d-87e3-fa381abdfa3f tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Created volume successfully. Jul 21 02:17:07 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4d19f3f6-7e34-4d40-b9ac-3aa1803385fc tempest-VolumesDeleteCascade-1628845007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.413s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-4d19f3f6-7e34-4d40-b9ac-3aa1803385fc tempest-VolumesDeleteCascade-1628845007 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:17:07 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-4d19f3f6-7e34-4d40-b9ac-3aa1803385fc tempest-VolumesDeleteCascade-1628845007 None] Deleted volume successfully. Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] Flow 'volume_create_manager' (c2ce2d61-1c55-4f63-bc4a-8446e9976f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a56076da-b8af-4c98-9e71-b8a1f6e51a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4d19f3f6-7e34-4d40-b9ac-3aa1803385fc tempest-VolumesDeleteCascade-1628845007 None] Lock "cinder-b52171f7-a186-4842-9d28-70c68fc660ad-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a56076da-b8af-4c98-9e71-b8a1f6e51a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1392707714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d2c3789-af98-4c25-846e-34adec28a396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d58d4b0371344fe9bdcab12e8f7b982e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:17:07Z,use_quota=True,user_id='21893ccd6f9e4b6794ad3d94839bfb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c8bcad-37b1-4716-9c72-48f1559cf91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c8bcad-37b1-4716-9c72-48f1559cf91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d592121-9f27-4f7a-99a1-5c5127e4a60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d592121-9f27-4f7a-99a1-5c5127e4a60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d2c3789-af98-4c25-846e-34adec28a396', 'volume_name': 'volume-1d2c3789-af98-4c25-846e-34adec28a396', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a3fdb01-b5cc-44b7-b129-21a70be57d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a3fdb01-b5cc-44b7-b129-21a70be57d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3abd0d6-5e7c-4705-a393-85820920ff7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:07 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] Volume 1d2c3789-af98-4c25-846e-34adec28a396: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d2c3789-af98-4c25-846e-34adec28a396', 'volume_size': 1} Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:07 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211 2147483648" returned: 0 in 0.635s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:07 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211 Jul 21 02:17:07 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:07 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211" returned: 0 in 0.249s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.536s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1392707714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d2c3789-af98-4c25-846e-34adec28a396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d58d4b0371344fe9bdcab12e8f7b982e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:17:07Z,use_quota=True,user_id='21893ccd6f9e4b6794ad3d94839bfb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] Creating volume 1d2c3789-af98-4c25-846e-34adec28a396 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:17:07 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1d2c3789-af98-4c25-846e-34adec28a396 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (584737b0-f706-4843-8fc8-7f4f42569792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f876b084-2f8b-47f1-9e55-c54672981211', 'volume_size': 2}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:07 devstack sudo[100528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1d2c3789-af98-4c25-846e-34adec28a396 1073741824 Jul 21 02:17:07 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf9436d-f5c2-4ad3-b6c6-4066bc4a7710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:07 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Volume volume-f876b084-2f8b-47f1-9e55-c54672981211 (f876b084-2f8b-47f1-9e55-c54672981211): created successfully Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf9436d-f5c2-4ad3-b6c6-4066bc4a7710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Flow 'volume_create_manager' (0c898518-3bdb-422c-b833-1c0a30b84eec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:17:07 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-652989ef-d5c9-4dee-a6bd-587e947ab8fb tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Created volume successfully. Jul 21 02:17:08 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1d2c3789-af98-4c25-846e-34adec28a396 1073741824" returned: 0 in 0.581s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1d2c3789-af98-4c25-846e-34adec28a396 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:08 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1d2c3789-af98-4c25-846e-34adec28a396 Jul 21 02:17:08 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-425a1dc8-9eb6-41e2-adee-fd30cee44709 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:08 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:17:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Flow 'volume_create_manager' (d9b9748f-c2a1-498b-923e-48dfffd754e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:17:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c5da714-3bf8-4374-8317-0c773fe91735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c5da714-3bf8-4374-8317-0c773fe91735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-740305678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=027e8b21-fcd4-4f9d-9eca-6aea01cd94bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c387144ab3b6448c8c5fb3bf3080c9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:17:09Z,use_quota=True,user_id='47229f2f1f3440e28f34d14fa0d3657a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef51715-3090-4e2b-85e6-c986e237037c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef51715-3090-4e2b-85e6-c986e237037c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77318a9e-32f8-4f0f-80e8-01fc88aff69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77318a9e-32f8-4f0f-80e8-01fc88aff69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '027e8b21-fcd4-4f9d-9eca-6aea01cd94bc', 'volume_name': 'volume-027e8b21-fcd4-4f9d-9eca-6aea01cd94bc', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e071bf-b899-4daf-86f2-42d33fccef57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e071bf-b899-4daf-86f2-42d33fccef57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9409c138-7ef8-4384-a6ba-3d51f98ad3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:08 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Volume 027e8b21-fcd4-4f9d-9eca-6aea01cd94bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-027e8b21-fcd4-4f9d-9eca-6aea01cd94bc', 'volume_size': 1} Jul 21 02:17:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:08 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1d2c3789-af98-4c25-846e-34adec28a396" returned: 0 in 0.336s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:17:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-425a1dc8-9eb6-41e2-adee-fd30cee44709 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.162s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3abd0d6-5e7c-4705-a393-85820920ff7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d2c3789-af98-4c25-846e-34adec28a396', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8400f712-1782-4c65-a7aa-a9322e16eac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-425a1dc8-9eb6-41e2-adee-fd30cee44709 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Creating offline snapshot 9a38ddc7-376a-48e0-a079-e14363627dd4 of volume f876b084-2f8b-47f1-9e55-c54672981211 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:17:08 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] Volume volume-1d2c3789-af98-4c25-846e-34adec28a396 (1d2c3789-af98-4c25-846e-34adec28a396): created successfully Jul 21 02:17:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8400f712-1782-4c65-a7aa-a9322e16eac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] Flow 'volume_create_manager' (c2ce2d61-1c55-4f63-bc4a-8446e9976f6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:17:08 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd606bc6-d8de-4c48-ae57-cc28187873d3]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:17:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-425a1dc8-9eb6-41e2-adee-fd30cee44709 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:08 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-0b252b0c-1cca-4fe5-8aef-3e82e5282531 tempest-VolumesTransfersV357Test-1916241121 None] Created volume successfully. Jul 21 02:17:09 devstack sudo[100536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211 Jul 21 02:17:09 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:09 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:17:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Flow 'volume_create_manager' (5483577a-4d35-4f7a-9028-534aa35baa88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:17:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6504c439-1834-4554-a978-2358ceadd017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6504c439-1834-4554-a978-2358ceadd017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1264947583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=487bd106-dbc3-40e5-bc9f-a5144bfe84a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c387144ab3b6448c8c5fb3bf3080c9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:17:09Z,use_quota=True,user_id='47229f2f1f3440e28f34d14fa0d3657a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67e1d27b-f177-442a-ad05-9a67cf94e86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67e1d27b-f177-442a-ad05-9a67cf94e86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (853a2485-289f-418b-9b96-bde30e2fa6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (853a2485-289f-418b-9b96-bde30e2fa6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '487bd106-dbc3-40e5-bc9f-a5144bfe84a9', 'volume_name': 'volume-487bd106-dbc3-40e5-bc9f-a5144bfe84a9', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7fa1046-ef2b-40ab-a9ff-9131798dbbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7fa1046-ef2b-40ab-a9ff-9131798dbbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (589e34b6-50e5-4fb0-8abd-fd9e1da1dac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:09 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Volume 487bd106-dbc3-40e5-bc9f-a5144bfe84a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-487bd106-dbc3-40e5-bc9f-a5144bfe84a9', 'volume_size': 1} Jul 21 02:17:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:09 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-425a1dc8-9eb6-41e2-adee-fd30cee44709 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211" returned: 0 in 0.481s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-425a1dc8-9eb6-41e2-adee-fd30cee44709 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211.9a38ddc7-376a-48e0-a079-e14363627dd4 2G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:09 devstack sudo[100541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211.9a38ddc7-376a-48e0-a079-e14363627dd4 2G Jul 21 02:17:09 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:09 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:17:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Flow 'volume_create_manager' (ac027512-1ca1-4ce7-8d5b-3f07984da6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:17:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02741674-62f7-4bb0-ab15-c4384ad25615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02741674-62f7-4bb0-ab15-c4384ad25615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1368554172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a92330a-08d9-44bd-b6a0-591ed8f207f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c387144ab3b6448c8c5fb3bf3080c9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:17:10Z,use_quota=True,user_id='47229f2f1f3440e28f34d14fa0d3657a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead0d0e3-5db8-4eda-a863-3f8b36a99a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead0d0e3-5db8-4eda-a863-3f8b36a99a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b53ffd5-43ff-4635-a3d0-912315872d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b53ffd5-43ff-4635-a3d0-912315872d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a92330a-08d9-44bd-b6a0-591ed8f207f5', 'volume_name': 'volume-1a92330a-08d9-44bd-b6a0-591ed8f207f5', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb45b7a-5213-4202-9a72-c22047f73f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb45b7a-5213-4202-9a72-c22047f73f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e558a4aa-3348-4947-a954-2cf25a0be753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:09 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Volume 1a92330a-08d9-44bd-b6a0-591ed8f207f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a92330a-08d9-44bd-b6a0-591ed8f207f5', 'volume_size': 1} Jul 21 02:17:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:09 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f7401dd4-f679-4dfd-9695-7cc94cf7ffae tempest-VolumesTransfersV357Test-1054355940 None] Acquiring lock "cinder-1d2c3789-af98-4c25-846e-34adec28a396-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:09 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f7401dd4-f679-4dfd-9695-7cc94cf7ffae tempest-VolumesTransfersV357Test-1054355940 None] Lock "cinder-1d2c3789-af98-4c25-846e-34adec28a396-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:09 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f7401dd4-f679-4dfd-9695-7cc94cf7ffae tempest-VolumesTransfersV357Test-1054355940 None] Acquiring lock "cinder-quobyte-1d2c3789-af98-4c25-846e-34adec28a396" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:09 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f7401dd4-f679-4dfd-9695-7cc94cf7ffae tempest-VolumesTransfersV357Test-1054355940 None] Lock "cinder-quobyte-1d2c3789-af98-4c25-846e-34adec28a396" acquired by "delete_volume" :: waited 0.032s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:09 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[485028f8-c134-4bca-b4c3-9c6afc6283c2]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:17:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f7401dd4-f679-4dfd-9695-7cc94cf7ffae tempest-VolumesTransfersV357Test-1054355940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1d2c3789-af98-4c25-846e-34adec28a396 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:10 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-425a1dc8-9eb6-41e2-adee-fd30cee44709 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211.9a38ddc7-376a-48e0-a079-e14363627dd4 2G" returned: 0 in 0.632s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-425a1dc8-9eb6-41e2-adee-fd30cee44709 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f876b084-2f8b-47f1-9e55-c54672981211 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211.9a38ddc7-376a-48e0-a079-e14363627dd4 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:10 devstack sudo[100548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f876b084-2f8b-47f1-9e55-c54672981211 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211.9a38ddc7-376a-48e0-a079-e14363627dd4 Jul 21 02:17:10 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:10 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1d2c3789-af98-4c25-846e-34adec28a396 Jul 21 02:17:10 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Flow 'volume_create_manager' (c340a453-58bf-4e91-8c7f-bdeba4abce6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2161b57f-637c-4535-959e-4e181c8dbad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2161b57f-637c-4535-959e-4e181c8dbad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-292727482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d211f76-3759-4c52-afd2-ec891c9a3778,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c387144ab3b6448c8c5fb3bf3080c9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:17:10Z,use_quota=True,user_id='47229f2f1f3440e28f34d14fa0d3657a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0688b1-f23d-455d-b351-b1990f30f68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0688b1-f23d-455d-b351-b1990f30f68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e80d7e2-d29f-4548-b804-e4a3f862a79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e80d7e2-d29f-4548-b804-e4a3f862a79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d211f76-3759-4c52-afd2-ec891c9a3778', 'volume_name': 'volume-9d211f76-3759-4c52-afd2-ec891c9a3778', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9421bb7e-b64a-4994-a37f-f5769a250b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9421bb7e-b64a-4994-a37f-f5769a250b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7af9ab-f797-48da-89ca-04697c19a579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:10 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Volume 9d211f76-3759-4c52-afd2-ec891c9a3778: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d211f76-3759-4c52-afd2-ec891c9a3778', 'volume_size': 1} Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:10 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-425a1dc8-9eb6-41e2-adee-fd30cee44709 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f876b084-2f8b-47f1-9e55-c54672981211 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211.9a38ddc7-376a-48e0-a079-e14363627dd4" returned: 0 in 0.464s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:10 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-425a1dc8-9eb6-41e2-adee-fd30cee44709 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211.9a38ddc7-376a-48e0-a079-e14363627dd4 is being set with open permissions: ugo+rw Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-425a1dc8-9eb6-41e2-adee-fd30cee44709 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211.9a38ddc7-376a-48e0-a079-e14363627dd4 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:10 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f7401dd4-f679-4dfd-9695-7cc94cf7ffae tempest-VolumesTransfersV357Test-1054355940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1d2c3789-af98-4c25-846e-34adec28a396" returned: 0 in 0.597s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f7401dd4-f679-4dfd-9695-7cc94cf7ffae tempest-VolumesTransfersV357Test-1054355940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1d2c3789-af98-4c25-846e-34adec28a396 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:10 devstack sudo[100557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211.9a38ddc7-376a-48e0-a079-e14363627dd4 Jul 21 02:17:10 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:10 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1d2c3789-af98-4c25-846e-34adec28a396 Jul 21 02:17:10 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Flow 'volume_create_manager' (01a7d9a2-ff32-4137-8421-8be00e29bc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea5070d-c13c-492f-bc32-26bd28196b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea5070d-c13c-492f-bc32-26bd28196b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-20870740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=267d2524-e150-4a48-8d5d-1d7aaffc19c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c387144ab3b6448c8c5fb3bf3080c9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:17:11Z,use_quota=True,user_id='47229f2f1f3440e28f34d14fa0d3657a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f61add-9cd7-418b-a150-c0bd2ad5ead9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f61add-9cd7-418b-a150-c0bd2ad5ead9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2873320-4743-4fe0-809a-597b01472571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2873320-4743-4fe0-809a-597b01472571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '267d2524-e150-4a48-8d5d-1d7aaffc19c3', 'volume_name': 'volume-267d2524-e150-4a48-8d5d-1d7aaffc19c3', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ffcf8fd-0b51-49af-afe2-e4039cccd204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ffcf8fd-0b51-49af-afe2-e4039cccd204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a8f9a0-8cab-4bdb-9365-bf899b03c78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:10 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Volume 267d2524-e150-4a48-8d5d-1d7aaffc19c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-267d2524-e150-4a48-8d5d-1d7aaffc19c3', 'volume_size': 1} Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:10 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-425a1dc8-9eb6-41e2-adee-fd30cee44709 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211.9a38ddc7-376a-48e0-a079-e14363627dd4" returned: 0 in 0.334s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:10 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-425a1dc8-9eb6-41e2-adee-fd30cee44709 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f7401dd4-f679-4dfd-9695-7cc94cf7ffae tempest-VolumesTransfersV357Test-1054355940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1d2c3789-af98-4c25-846e-34adec28a396" returned: 0 in 0.348s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:10 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211.info Jul 21 02:17:10 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f7401dd4-f679-4dfd-9695-7cc94cf7ffae tempest-VolumesTransfersV357Test-1054355940 None] Lock "cinder-quobyte-1d2c3789-af98-4c25-846e-34adec28a396" released by "delete_volume" :: held 1.018s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] Flow 'volume_create_manager' (2e9cc7f8-fbd2-4689-8387-2b00ec3d0611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:17:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c26c3987-0bc9-40f7-9078-0f421e32255c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c26c3987-0bc9-40f7-9078-0f421e32255c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1079325588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ef14e9-5792-432b-80e5-5c4ca40778c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c576b3cfe04648ac1f3747e4c95d08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:17:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:17:11Z,use_quota=True,user_id='0b2887cb2b16462180d65c391fc8f460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be8c4681-80be-4467-b693-e3b90eccdb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be8c4681-80be-4467-b693-e3b90eccdb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4714a5a9-976a-4f81-8f83-6f509ce6bedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4714a5a9-976a-4f81-8f83-6f509ce6bedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0ef14e9-5792-432b-80e5-5c4ca40778c8', 'volume_name': 'volume-e0ef14e9-5792-432b-80e5-5c4ca40778c8', 'volume_size': 2}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd18c98-92b8-4914-bb12-ff2e876095ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd18c98-92b8-4914-bb12-ff2e876095ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f9ed4ea-8816-4814-81c3-e6b9c0375dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:11 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] Volume e0ef14e9-5792-432b-80e5-5c4ca40778c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0ef14e9-5792-432b-80e5-5c4ca40778c8', 'volume_size': 2} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-f7401dd4-f679-4dfd-9695-7cc94cf7ffae tempest-VolumesTransfersV357Test-1054355940 None] Created reservations ['a45c819d-f6b8-43e0-95d7-26c0f99e8243', 'f67b853c-d6c5-4800-a8e8-437a4295b598', 'c1075f3e-bbdc-472e-bd16-b43822349bed', '97dfa2b3-17fc-4137-a044-5e0df44e48e3'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:17:11 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-425a1dc8-9eb6-41e2-adee-fd30cee44709 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211.info" returned: 0 in 0.274s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:11 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-425a1dc8-9eb6-41e2-adee-fd30cee44709 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211.info is being set with open permissions: ugo+rw Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-425a1dc8-9eb6-41e2-adee-fd30cee44709 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:11 devstack sudo[100566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211.info Jul 21 02:17:11 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f7401dd4-f679-4dfd-9695-7cc94cf7ffae tempest-VolumesTransfersV357Test-1054355940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f7401dd4-f679-4dfd-9695-7cc94cf7ffae tempest-VolumesTransfersV357Test-1054355940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f7401dd4-f679-4dfd-9695-7cc94cf7ffae tempest-VolumesTransfersV357Test-1054355940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f7401dd4-f679-4dfd-9695-7cc94cf7ffae tempest-VolumesTransfersV357Test-1054355940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f7401dd4-f679-4dfd-9695-7cc94cf7ffae tempest-VolumesTransfersV357Test-1054355940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f7401dd4-f679-4dfd-9695-7cc94cf7ffae tempest-VolumesTransfersV357Test-1054355940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:11 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:17:11 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:11 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-425a1dc8-9eb6-41e2-adee-fd30cee44709 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211.info" returned: 0 in 0.281s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-425a1dc8-9eb6-41e2-adee-fd30cee44709 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.605s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.662s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-740305678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=027e8b21-fcd4-4f9d-9eca-6aea01cd94bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c387144ab3b6448c8c5fb3bf3080c9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:17:09Z,use_quota=True,user_id='47229f2f1f3440e28f34d14fa0d3657a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Creating volume 027e8b21-fcd4-4f9d-9eca-6aea01cd94bc {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:17:11 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:17:11 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-027e8b21-fcd4-4f9d-9eca-6aea01cd94bc 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f7401dd4-f679-4dfd-9695-7cc94cf7ffae tempest-VolumesTransfersV357Test-1054355940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.271s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-f7401dd4-f679-4dfd-9695-7cc94cf7ffae tempest-VolumesTransfersV357Test-1054355940 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:17:11 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-027e8b21-fcd4-4f9d-9eca-6aea01cd94bc 1073741824 Jul 21 02:17:11 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:11 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-f7401dd4-f679-4dfd-9695-7cc94cf7ffae tempest-VolumesTransfersV357Test-1054355940 None] Deleted volume successfully. Jul 21 02:17:11 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-425a1dc8-9eb6-41e2-adee-fd30cee44709 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Create snapshot completed successfully Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f7401dd4-f679-4dfd-9695-7cc94cf7ffae tempest-VolumesTransfersV357Test-1054355940 None] Lock "cinder-1d2c3789-af98-4c25-846e-34adec28a396-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:11 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-027e8b21-fcd4-4f9d-9eca-6aea01cd94bc 1073741824" returned: 0 in 0.441s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cfea51a1-02d8-4eb5-ba45-4aaecd99c34e tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Acquiring lock "cinder-9a38ddc7-376a-48e0-a079-e14363627dd4-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cfea51a1-02d8-4eb5-ba45-4aaecd99c34e tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Lock "cinder-9a38ddc7-376a-48e0-a079-e14363627dd4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cfea51a1-02d8-4eb5-ba45-4aaecd99c34e tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Acquiring lock "cinder-quobyte-f876b084-2f8b-47f1-9e55-c54672981211" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cfea51a1-02d8-4eb5-ba45-4aaecd99c34e tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Lock "cinder-quobyte-f876b084-2f8b-47f1-9e55-c54672981211" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cfea51a1-02d8-4eb5-ba45-4aaecd99c34e tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Acquiring lock "cinder-quobyte-9a38ddc7-376a-48e0-a079-e14363627dd4" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-027e8b21-fcd4-4f9d-9eca-6aea01cd94bc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cfea51a1-02d8-4eb5-ba45-4aaecd99c34e tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Lock "cinder-quobyte-9a38ddc7-376a-48e0-a079-e14363627dd4" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:11 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-cfea51a1-02d8-4eb5-ba45-4aaecd99c34e tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Deleting offline snapshot 9a38ddc7-376a-48e0-a079-e14363627dd4 of volume f876b084-2f8b-47f1-9e55-c54672981211 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:17:11 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-027e8b21-fcd4-4f9d-9eca-6aea01cd94bc Jul 21 02:17:11 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-cfea51a1-02d8-4eb5-ba45-4aaecd99c34e tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] snapshot_file for this snap is: volume-f876b084-2f8b-47f1-9e55-c54672981211.9a38ddc7-376a-48e0-a079-e14363627dd4 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:17:12 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da89e2f-1cc0-4b44-ae35-25b17c1b7bc7]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:17:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cfea51a1-02d8-4eb5-ba45-4aaecd99c34e tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211.9a38ddc7-376a-48e0-a079-e14363627dd4 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:12 devstack sudo[100580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211.9a38ddc7-376a-48e0-a079-e14363627dd4 Jul 21 02:17:12 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:12 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-027e8b21-fcd4-4f9d-9eca-6aea01cd94bc" returned: 0 in 0.268s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:17:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.899s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1264947583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=487bd106-dbc3-40e5-bc9f-a5144bfe84a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c387144ab3b6448c8c5fb3bf3080c9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:17:09Z,use_quota=True,user_id='47229f2f1f3440e28f34d14fa0d3657a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:17:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Creating volume 487bd106-dbc3-40e5-bc9f-a5144bfe84a9 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:17:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:17:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:17:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:17:12 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:17:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-487bd106-dbc3-40e5-bc9f-a5144bfe84a9 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9409c138-7ef8-4384-a6ba-3d51f98ad3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-027e8b21-fcd4-4f9d-9eca-6aea01cd94bc', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f37b30-d80a-4d9c-a59b-f932b9cfbee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:12 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-487bd106-dbc3-40e5-bc9f-a5144bfe84a9 1073741824 Jul 21 02:17:12 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:12 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Volume volume-027e8b21-fcd4-4f9d-9eca-6aea01cd94bc (027e8b21-fcd4-4f9d-9eca-6aea01cd94bc): created successfully Jul 21 02:17:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f37b30-d80a-4d9c-a59b-f932b9cfbee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Flow 'volume_create_manager' (d9b9748f-c2a1-498b-923e-48dfffd754e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:17:12 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-ed2036f6-8a3e-4c1d-881b-a60f60649584 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Created volume successfully. Jul 21 02:17:12 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cfea51a1-02d8-4eb5-ba45-4aaecd99c34e tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211.9a38ddc7-376a-48e0-a079-e14363627dd4" returned: 0 in 0.406s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-cfea51a1-02d8-4eb5-ba45-4aaecd99c34e tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f876b084-2f8b-47f1-9e55-c54672981211(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:17:12 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d710a2b-1a1e-478a-b4db-edefa46f4fea]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:17:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cfea51a1-02d8-4eb5-ba45-4aaecd99c34e tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:12 devstack sudo[100588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211 Jul 21 02:17:12 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:12 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-487bd106-dbc3-40e5-bc9f-a5144bfe84a9 1073741824" returned: 0 in 0.541s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-487bd106-dbc3-40e5-bc9f-a5144bfe84a9 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:12 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-487bd106-dbc3-40e5-bc9f-a5144bfe84a9 Jul 21 02:17:12 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:12 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cfea51a1-02d8-4eb5-ba45-4aaecd99c34e tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211" returned: 0 in 0.412s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cfea51a1-02d8-4eb5-ba45-4aaecd99c34e tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211.9a38ddc7-376a-48e0-a079-e14363627dd4 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:12 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211.9a38ddc7-376a-48e0-a079-e14363627dd4 Jul 21 02:17:12 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:13 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-487bd106-dbc3-40e5-bc9f-a5144bfe84a9" returned: 0 in 0.293s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:17:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.329s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1368554172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a92330a-08d9-44bd-b6a0-591ed8f207f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c387144ab3b6448c8c5fb3bf3080c9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:17:10Z,use_quota=True,user_id='47229f2f1f3440e28f34d14fa0d3657a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:17:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Creating volume 1a92330a-08d9-44bd-b6a0-591ed8f207f5 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:17:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:17:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:17:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:17:13 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:17:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1a92330a-08d9-44bd-b6a0-591ed8f207f5 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (589e34b6-50e5-4fb0-8abd-fd9e1da1dac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-487bd106-dbc3-40e5-bc9f-a5144bfe84a9', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:13 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1a92330a-08d9-44bd-b6a0-591ed8f207f5 1073741824 Jul 21 02:17:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41c5803d-2b66-4567-9ef5-31de215df2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:13 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:13 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Volume volume-487bd106-dbc3-40e5-bc9f-a5144bfe84a9 (487bd106-dbc3-40e5-bc9f-a5144bfe84a9): created successfully Jul 21 02:17:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41c5803d-2b66-4567-9ef5-31de215df2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Flow 'volume_create_manager' (5483577a-4d35-4f7a-9028-534aa35baa88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:17:13 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-9d33781e-6d23-4e7f-8ca3-3940ee0377cc tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Created volume successfully. Jul 21 02:17:13 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cfea51a1-02d8-4eb5-ba45-4aaecd99c34e tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211.9a38ddc7-376a-48e0-a079-e14363627dd4" returned: 0 in 0.408s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cfea51a1-02d8-4eb5-ba45-4aaecd99c34e tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211.9a38ddc7-376a-48e0-a079-e14363627dd4 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:13 devstack sudo[100609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211.9a38ddc7-376a-48e0-a079-e14363627dd4 Jul 21 02:17:13 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:13 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cfea51a1-02d8-4eb5-ba45-4aaecd99c34e tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211.9a38ddc7-376a-48e0-a079-e14363627dd4" returned: 0 in 0.309s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:13 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cfea51a1-02d8-4eb5-ba45-4aaecd99c34e tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Lock "cinder-quobyte-9a38ddc7-376a-48e0-a079-e14363627dd4" released by "_delete_snapshot" :: held 1.671s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:13 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1a92330a-08d9-44bd-b6a0-591ed8f207f5 1073741824" returned: 0 in 0.518s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:13 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cfea51a1-02d8-4eb5-ba45-4aaecd99c34e tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Lock "cinder-quobyte-f876b084-2f8b-47f1-9e55-c54672981211" released by "delete_snapshot" :: held 1.716s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1a92330a-08d9-44bd-b6a0-591ed8f207f5 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:13 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1a92330a-08d9-44bd-b6a0-591ed8f207f5 Jul 21 02:17:13 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:13 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-cfea51a1-02d8-4eb5-ba45-4aaecd99c34e tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Created reservations ['6b2c6a84-ef63-4c16-83ec-9d9325396b0e', '6df9d735-7adb-4043-a9c4-63e0a77624dd', '6b8dc77a-9082-486d-b66d-8f9299fb764f', 'b1da65f3-d676-46f2-b1c5-bb239a8a3e7f'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:17:13 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-cfea51a1-02d8-4eb5-ba45-4aaecd99c34e tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Delete snapshot completed successfully. Jul 21 02:17:13 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cfea51a1-02d8-4eb5-ba45-4aaecd99c34e tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Lock "cinder-9a38ddc7-376a-48e0-a079-e14363627dd4-delete_snapshot" released by "delete_snapshot" :: held 1.911s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:14 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1a92330a-08d9-44bd-b6a0-591ed8f207f5" returned: 0 in 0.330s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.620s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-292727482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d211f76-3759-4c52-afd2-ec891c9a3778,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c387144ab3b6448c8c5fb3bf3080c9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:17:10Z,use_quota=True,user_id='47229f2f1f3440e28f34d14fa0d3657a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Creating volume 9d211f76-3759-4c52-afd2-ec891c9a3778 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:17:14 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9d211f76-3759-4c52-afd2-ec891c9a3778 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e558a4aa-3348-4947-a954-2cf25a0be753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a92330a-08d9-44bd-b6a0-591ed8f207f5', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08cb1e3f-3f89-4634-9026-4123492351f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:14 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9d211f76-3759-4c52-afd2-ec891c9a3778 1073741824 Jul 21 02:17:14 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:14 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Volume volume-1a92330a-08d9-44bd-b6a0-591ed8f207f5 (1a92330a-08d9-44bd-b6a0-591ed8f207f5): created successfully Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08cb1e3f-3f89-4634-9026-4123492351f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Flow 'volume_create_manager' (ac027512-1ca1-4ce7-8d5b-3f07984da6d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:17:14 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-84f60e96-82a5-408c-b94c-1e6e77560277 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Created volume successfully. Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-0f0e20c8-3a42-4d58-9bbb-2962008b1805 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Acquiring lock "cinder-f876b084-2f8b-47f1-9e55-c54672981211-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-0f0e20c8-3a42-4d58-9bbb-2962008b1805 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Lock "cinder-f876b084-2f8b-47f1-9e55-c54672981211-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-0f0e20c8-3a42-4d58-9bbb-2962008b1805 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Acquiring lock "cinder-quobyte-f876b084-2f8b-47f1-9e55-c54672981211" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-0f0e20c8-3a42-4d58-9bbb-2962008b1805 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Lock "cinder-quobyte-f876b084-2f8b-47f1-9e55-c54672981211" acquired by "delete_volume" :: waited 0.018s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c60a218-8542-4df7-a428-567b6c75affc]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0f0e20c8-3a42-4d58-9bbb-2962008b1805 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:14 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211 Jul 21 02:17:14 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:14 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9d211f76-3759-4c52-afd2-ec891c9a3778 1073741824" returned: 0 in 0.563s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9d211f76-3759-4c52-afd2-ec891c9a3778 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:14 devstack sudo[100631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9d211f76-3759-4c52-afd2-ec891c9a3778 Jul 21 02:17:14 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:14 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0f0e20c8-3a42-4d58-9bbb-2962008b1805 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211" returned: 0 in 0.414s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0f0e20c8-3a42-4d58-9bbb-2962008b1805 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:14 devstack sudo[100633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211 Jul 21 02:17:14 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:14 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9d211f76-3759-4c52-afd2-ec891c9a3778" returned: 0 in 0.282s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.255s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-20870740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=267d2524-e150-4a48-8d5d-1d7aaffc19c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c387144ab3b6448c8c5fb3bf3080c9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:17:11Z,use_quota=True,user_id='47229f2f1f3440e28f34d14fa0d3657a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Creating volume 267d2524-e150-4a48-8d5d-1d7aaffc19c3 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:17:14 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-267d2524-e150-4a48-8d5d-1d7aaffc19c3 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:15 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7af9ab-f797-48da-89ca-04697c19a579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d211f76-3759-4c52-afd2-ec891c9a3778', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa6fc37d-9495-4677-95fe-076f17a36c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:15 devstack sudo[100637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-267d2524-e150-4a48-8d5d-1d7aaffc19c3 1073741824 Jul 21 02:17:15 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0f0e20c8-3a42-4d58-9bbb-2962008b1805 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f876b084-2f8b-47f1-9e55-c54672981211" returned: 0 in 0.324s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-0f0e20c8-3a42-4d58-9bbb-2962008b1805 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Lock "cinder-quobyte-f876b084-2f8b-47f1-9e55-c54672981211" released by "delete_volume" :: held 0.816s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:15 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Volume volume-9d211f76-3759-4c52-afd2-ec891c9a3778 (9d211f76-3759-4c52-afd2-ec891c9a3778): created successfully Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa6fc37d-9495-4677-95fe-076f17a36c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Flow 'volume_create_manager' (c340a453-58bf-4e91-8c7f-bdeba4abce6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:17:15 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-8a8e637d-516b-47fe-8fd2-25bace28493e tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Created volume successfully. Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-0f0e20c8-3a42-4d58-9bbb-2962008b1805 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Created reservations ['a7288aaf-ac05-4453-b6c6-88099f217c30', 'aa4e4fb5-b798-433d-a960-3f0327a252a6', '1d682758-a892-4cc7-bfe4-64d1e13cb859', '2cdb84bf-f9a6-4e0d-89fb-0325796f72f7'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0f0e20c8-3a42-4d58-9bbb-2962008b1805 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0f0e20c8-3a42-4d58-9bbb-2962008b1805 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0f0e20c8-3a42-4d58-9bbb-2962008b1805 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0f0e20c8-3a42-4d58-9bbb-2962008b1805 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0f0e20c8-3a42-4d58-9bbb-2962008b1805 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0f0e20c8-3a42-4d58-9bbb-2962008b1805 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:15 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:17:15 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:15 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-267d2524-e150-4a48-8d5d-1d7aaffc19c3 1073741824" returned: 0 in 0.531s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-267d2524-e150-4a48-8d5d-1d7aaffc19c3 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:15 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0f0e20c8-3a42-4d58-9bbb-2962008b1805 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.347s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-0f0e20c8-3a42-4d58-9bbb-2962008b1805 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:17:15 devstack sudo[100646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-267d2524-e150-4a48-8d5d-1d7aaffc19c3 Jul 21 02:17:15 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:15 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-0f0e20c8-3a42-4d58-9bbb-2962008b1805 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Deleted volume successfully. Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-0f0e20c8-3a42-4d58-9bbb-2962008b1805 tempest-VolumesSnapshotNegativeTestJSON-2143966564 None] Lock "cinder-f876b084-2f8b-47f1-9e55-c54672981211-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:15 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-267d2524-e150-4a48-8d5d-1d7aaffc19c3" returned: 0 in 0.329s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.869s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1079325588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ef14e9-5792-432b-80e5-5c4ca40778c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c576b3cfe04648ac1f3747e4c95d08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:17:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:17:11Z,use_quota=True,user_id='0b2887cb2b16462180d65c391fc8f460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] Creating volume e0ef14e9-5792-432b-80e5-5c4ca40778c8 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:17:15 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0ef14e9-5792-432b-80e5-5c4ca40778c8 2147483648 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a8f9a0-8cab-4bdb-9365-bf899b03c78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-267d2524-e150-4a48-8d5d-1d7aaffc19c3', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:15 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0ef14e9-5792-432b-80e5-5c4ca40778c8 2147483648 Jul 21 02:17:15 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07441ed9-d787-425f-bcae-5049a753d706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:15 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Volume volume-267d2524-e150-4a48-8d5d-1d7aaffc19c3 (267d2524-e150-4a48-8d5d-1d7aaffc19c3): created successfully Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07441ed9-d787-425f-bcae-5049a753d706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Flow 'volume_create_manager' (01a7d9a2-ff32-4137-8421-8be00e29bc74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:17:16 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-68f1a110-9432-434f-b0a3-3c5242617d48 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Created volume successfully. Jul 21 02:17:16 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-0fa9da1d-2f1d-4b05-b9a2-a04ac40f6134 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Acquiring lock "cinder-267d2524-e150-4a48-8d5d-1d7aaffc19c3-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:16 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-0fa9da1d-2f1d-4b05-b9a2-a04ac40f6134 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "cinder-267d2524-e150-4a48-8d5d-1d7aaffc19c3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:16 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-0fa9da1d-2f1d-4b05-b9a2-a04ac40f6134 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Acquiring lock "cinder-quobyte-267d2524-e150-4a48-8d5d-1d7aaffc19c3" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:16 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-0fa9da1d-2f1d-4b05-b9a2-a04ac40f6134 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "cinder-quobyte-267d2524-e150-4a48-8d5d-1d7aaffc19c3" acquired by "delete_volume" :: waited 0.029s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:16 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d58023-e643-4539-9ed9-907cb3f400f3]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:17:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0fa9da1d-2f1d-4b05-b9a2-a04ac40f6134 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-267d2524-e150-4a48-8d5d-1d7aaffc19c3 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:16 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-267d2524-e150-4a48-8d5d-1d7aaffc19c3 Jul 21 02:17:16 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:16 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0ef14e9-5792-432b-80e5-5c4ca40778c8 2147483648" returned: 0 in 0.791s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0ef14e9-5792-432b-80e5-5c4ca40778c8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:16 devstack sudo[100659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0ef14e9-5792-432b-80e5-5c4ca40778c8 Jul 21 02:17:16 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:17 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0fa9da1d-2f1d-4b05-b9a2-a04ac40f6134 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-267d2524-e150-4a48-8d5d-1d7aaffc19c3" returned: 0 in 0.490s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0fa9da1d-2f1d-4b05-b9a2-a04ac40f6134 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-267d2524-e150-4a48-8d5d-1d7aaffc19c3 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:17 devstack sudo[100664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-267d2524-e150-4a48-8d5d-1d7aaffc19c3 Jul 21 02:17:17 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:17 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0ef14e9-5792-432b-80e5-5c4ca40778c8" returned: 0 in 0.386s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:17 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:17:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:17 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f9ed4ea-8816-4814-81c3-e6b9c0375dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0ef14e9-5792-432b-80e5-5c4ca40778c8', 'volume_size': 2}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:17 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b10e068-2a67-42de-b19f-c157d115c505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:17 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] Volume volume-e0ef14e9-5792-432b-80e5-5c4ca40778c8 (e0ef14e9-5792-432b-80e5-5c4ca40778c8): created successfully Jul 21 02:17:17 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b10e068-2a67-42de-b19f-c157d115c505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:17 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] Flow 'volume_create_manager' (2e9cc7f8-fbd2-4689-8387-2b00ec3d0611) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:17:17 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-4f45c2de-1aff-4919-abd2-b96837dbc8ea tempest-VolumesCloneNegativeTest-689344407 None] Created volume successfully. Jul 21 02:17:17 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0fa9da1d-2f1d-4b05-b9a2-a04ac40f6134 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-267d2524-e150-4a48-8d5d-1d7aaffc19c3" returned: 0 in 0.318s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-0fa9da1d-2f1d-4b05-b9a2-a04ac40f6134 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "cinder-quobyte-267d2524-e150-4a48-8d5d-1d7aaffc19c3" released by "delete_volume" :: held 0.871s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:17 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-0fa9da1d-2f1d-4b05-b9a2-a04ac40f6134 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Created reservations ['ba0dc1b1-637d-45c0-833f-b84d06447dbd', '84250bfd-58a2-4808-b5ac-c59ef257681f', '715fe626-22b7-47b4-abf8-784ec1d0de8c', 'aadd166f-45bf-45ce-acdb-3a8508cd5d52'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:17:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0fa9da1d-2f1d-4b05-b9a2-a04ac40f6134 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0fa9da1d-2f1d-4b05-b9a2-a04ac40f6134 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:17 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0fa9da1d-2f1d-4b05-b9a2-a04ac40f6134 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:17:17 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0fa9da1d-2f1d-4b05-b9a2-a04ac40f6134 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:17:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0fa9da1d-2f1d-4b05-b9a2-a04ac40f6134 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0fa9da1d-2f1d-4b05-b9a2-a04ac40f6134 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:17 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:17:17 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-fdc85774-8153-4329-b84e-4a7747236d0d tempest-VolumesCloneNegativeTest-689344407 None] Acquiring lock "cinder-e0ef14e9-5792-432b-80e5-5c4ca40778c8-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-fdc85774-8153-4329-b84e-4a7747236d0d tempest-VolumesCloneNegativeTest-689344407 None] Lock "cinder-e0ef14e9-5792-432b-80e5-5c4ca40778c8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f577e079-f995-4714-bf29-100a57c84de2 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Acquiring lock "cinder-9d211f76-3759-4c52-afd2-ec891c9a3778-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-fdc85774-8153-4329-b84e-4a7747236d0d tempest-VolumesCloneNegativeTest-689344407 None] Acquiring lock "cinder-quobyte-e0ef14e9-5792-432b-80e5-5c4ca40778c8" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f577e079-f995-4714-bf29-100a57c84de2 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "cinder-9d211f76-3759-4c52-afd2-ec891c9a3778-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-fdc85774-8153-4329-b84e-4a7747236d0d tempest-VolumesCloneNegativeTest-689344407 None] Lock "cinder-quobyte-e0ef14e9-5792-432b-80e5-5c4ca40778c8" acquired by "delete_volume" :: waited 0.028s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:17 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b68af46-8bd1-4e39-9d44-a03ab960b3ba]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:17:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fdc85774-8153-4329-b84e-4a7747236d0d tempest-VolumesCloneNegativeTest-689344407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0ef14e9-5792-432b-80e5-5c4ca40778c8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f577e079-f995-4714-bf29-100a57c84de2 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Acquiring lock "cinder-quobyte-9d211f76-3759-4c52-afd2-ec891c9a3778" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f577e079-f995-4714-bf29-100a57c84de2 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "cinder-quobyte-9d211f76-3759-4c52-afd2-ec891c9a3778" acquired by "delete_volume" :: waited 0.030s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:17 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae15198-75dd-4c19-ad08-41d298991d3c]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:17:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f577e079-f995-4714-bf29-100a57c84de2 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9d211f76-3759-4c52-afd2-ec891c9a3778 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:17 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0fa9da1d-2f1d-4b05-b9a2-a04ac40f6134 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.420s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:18 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-0fa9da1d-2f1d-4b05-b9a2-a04ac40f6134 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:17:18 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-0fa9da1d-2f1d-4b05-b9a2-a04ac40f6134 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Deleted volume successfully. Jul 21 02:17:18 devstack sudo[100670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0ef14e9-5792-432b-80e5-5c4ca40778c8 Jul 21 02:17:18 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-0fa9da1d-2f1d-4b05-b9a2-a04ac40f6134 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "cinder-267d2524-e150-4a48-8d5d-1d7aaffc19c3-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:18 devstack sudo[100672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9d211f76-3759-4c52-afd2-ec891c9a3778 Jul 21 02:17:18 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:18 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fdc85774-8153-4329-b84e-4a7747236d0d tempest-VolumesCloneNegativeTest-689344407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0ef14e9-5792-432b-80e5-5c4ca40778c8" returned: 0 in 0.470s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fdc85774-8153-4329-b84e-4a7747236d0d tempest-VolumesCloneNegativeTest-689344407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0ef14e9-5792-432b-80e5-5c4ca40778c8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:18 devstack sudo[100678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0ef14e9-5792-432b-80e5-5c4ca40778c8 Jul 21 02:17:18 devstack sudo[100678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:18 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f577e079-f995-4714-bf29-100a57c84de2 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9d211f76-3759-4c52-afd2-ec891c9a3778" returned: 0 in 0.482s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f577e079-f995-4714-bf29-100a57c84de2 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9d211f76-3759-4c52-afd2-ec891c9a3778 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:18 devstack sudo[100683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9d211f76-3759-4c52-afd2-ec891c9a3778 Jul 21 02:17:18 devstack sudo[100683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:18 devstack sudo[100678]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fdc85774-8153-4329-b84e-4a7747236d0d tempest-VolumesCloneNegativeTest-689344407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0ef14e9-5792-432b-80e5-5c4ca40778c8" returned: 0 in 0.305s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-fdc85774-8153-4329-b84e-4a7747236d0d tempest-VolumesCloneNegativeTest-689344407 None] Lock "cinder-quobyte-e0ef14e9-5792-432b-80e5-5c4ca40778c8" released by "delete_volume" :: held 0.853s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:18 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-fdc85774-8153-4329-b84e-4a7747236d0d tempest-VolumesCloneNegativeTest-689344407 None] Created reservations ['68c38e35-61d6-436c-a9a9-484b5cb59aee', 'd2114b21-e300-48a9-88b0-5e623f9983f5', 'c26551f8-7cb2-49e5-823c-7c7234d65ce0', '0ce03bc3-c6d2-4e22-aad7-eadd96ee9dc8'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:17:18 devstack sudo[100683]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f577e079-f995-4714-bf29-100a57c84de2 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9d211f76-3759-4c52-afd2-ec891c9a3778" returned: 0 in 0.324s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f577e079-f995-4714-bf29-100a57c84de2 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "cinder-quobyte-9d211f76-3759-4c52-afd2-ec891c9a3778" released by "delete_volume" :: held 0.875s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-fdc85774-8153-4329-b84e-4a7747236d0d tempest-VolumesCloneNegativeTest-689344407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-fdc85774-8153-4329-b84e-4a7747236d0d tempest-VolumesCloneNegativeTest-689344407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-fdc85774-8153-4329-b84e-4a7747236d0d tempest-VolumesCloneNegativeTest-689344407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:17:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-fdc85774-8153-4329-b84e-4a7747236d0d tempest-VolumesCloneNegativeTest-689344407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:17:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-fdc85774-8153-4329-b84e-4a7747236d0d tempest-VolumesCloneNegativeTest-689344407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fdc85774-8153-4329-b84e-4a7747236d0d tempest-VolumesCloneNegativeTest-689344407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:18 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-f577e079-f995-4714-bf29-100a57c84de2 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Created reservations ['8b1605b0-7392-4a35-87b5-6f2448112e77', 'f6e6b1e4-ea1e-4826-aed5-c512195e2a5c', '10493969-f173-4c6b-a176-1b5d5ebb1621', '697adbe6-9e83-45a4-bacf-e041bf02044f'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:17:18 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:17:18 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f577e079-f995-4714-bf29-100a57c84de2 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f577e079-f995-4714-bf29-100a57c84de2 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:19 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f577e079-f995-4714-bf29-100a57c84de2 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:17:19 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f577e079-f995-4714-bf29-100a57c84de2 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:17:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f577e079-f995-4714-bf29-100a57c84de2 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f577e079-f995-4714-bf29-100a57c84de2 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:19 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:17:19 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:19 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fdc85774-8153-4329-b84e-4a7747236d0d tempest-VolumesCloneNegativeTest-689344407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.413s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:19 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-fdc85774-8153-4329-b84e-4a7747236d0d tempest-VolumesCloneNegativeTest-689344407 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:17:19 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-fdc85774-8153-4329-b84e-4a7747236d0d tempest-VolumesCloneNegativeTest-689344407 None] Deleted volume successfully. Jul 21 02:17:19 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-fdc85774-8153-4329-b84e-4a7747236d0d tempest-VolumesCloneNegativeTest-689344407 None] Lock "cinder-e0ef14e9-5792-432b-80e5-5c4ca40778c8-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:19 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f577e079-f995-4714-bf29-100a57c84de2 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.341s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:19 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-f577e079-f995-4714-bf29-100a57c84de2 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:17:19 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-f577e079-f995-4714-bf29-100a57c84de2 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Deleted volume successfully. Jul 21 02:17:19 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f577e079-f995-4714-bf29-100a57c84de2 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "cinder-9d211f76-3759-4c52-afd2-ec891c9a3778-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b4540fd7-3601-42eb-8270-513a9ef6294a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Acquiring lock "cinder-1a92330a-08d9-44bd-b6a0-591ed8f207f5-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b4540fd7-3601-42eb-8270-513a9ef6294a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "cinder-1a92330a-08d9-44bd-b6a0-591ed8f207f5-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b4540fd7-3601-42eb-8270-513a9ef6294a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Acquiring lock "cinder-quobyte-1a92330a-08d9-44bd-b6a0-591ed8f207f5" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b4540fd7-3601-42eb-8270-513a9ef6294a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "cinder-quobyte-1a92330a-08d9-44bd-b6a0-591ed8f207f5" acquired by "delete_volume" :: waited 0.022s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:20 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0ac9a2-b9b9-40a7-bf4c-afa459870cd5]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:17:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b4540fd7-3601-42eb-8270-513a9ef6294a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1a92330a-08d9-44bd-b6a0-591ed8f207f5 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:20 devstack sudo[100693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1a92330a-08d9-44bd-b6a0-591ed8f207f5 Jul 21 02:17:20 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:20 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b4540fd7-3601-42eb-8270-513a9ef6294a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1a92330a-08d9-44bd-b6a0-591ed8f207f5" returned: 0 in 0.466s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b4540fd7-3601-42eb-8270-513a9ef6294a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1a92330a-08d9-44bd-b6a0-591ed8f207f5 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:20 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1a92330a-08d9-44bd-b6a0-591ed8f207f5 Jul 21 02:17:20 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:21 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b4540fd7-3601-42eb-8270-513a9ef6294a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1a92330a-08d9-44bd-b6a0-591ed8f207f5" returned: 0 in 0.337s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:21 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b4540fd7-3601-42eb-8270-513a9ef6294a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "cinder-quobyte-1a92330a-08d9-44bd-b6a0-591ed8f207f5" released by "delete_volume" :: held 0.874s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:21 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:UPDATE=284,cinder:SELECT=239,cinder:INSERT=79,cinder:DELETE=22 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:17:21 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:DELETE=27,cinder:SELECT=208,cinder:UPDATE=293,cinder:INSERT=64 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:17:21 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-b4540fd7-3601-42eb-8270-513a9ef6294a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Created reservations ['e8ce9839-c454-4894-b7f4-6b5ef9fe971e', '6068a608-7036-4c66-a3a1-c2ffde5aeea3', 'ed93605c-586d-4da2-acf7-af7269f82370', '0262a133-9f9f-4136-9573-2935d9ca55e8'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:17:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b4540fd7-3601-42eb-8270-513a9ef6294a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b4540fd7-3601-42eb-8270-513a9ef6294a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:21 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b4540fd7-3601-42eb-8270-513a9ef6294a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:17:21 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b4540fd7-3601-42eb-8270-513a9ef6294a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:17:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b4540fd7-3601-42eb-8270-513a9ef6294a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b4540fd7-3601-42eb-8270-513a9ef6294a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:21 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:17:21 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:21 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1f3e0318-27ff-4e32-a972-4bd7d303da78 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Acquiring lock "cinder-487bd106-dbc3-40e5-bc9f-a5144bfe84a9-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:21 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1f3e0318-27ff-4e32-a972-4bd7d303da78 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "cinder-487bd106-dbc3-40e5-bc9f-a5144bfe84a9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:21 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1f3e0318-27ff-4e32-a972-4bd7d303da78 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Acquiring lock "cinder-quobyte-487bd106-dbc3-40e5-bc9f-a5144bfe84a9" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:21 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1f3e0318-27ff-4e32-a972-4bd7d303da78 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "cinder-quobyte-487bd106-dbc3-40e5-bc9f-a5144bfe84a9" acquired by "delete_volume" :: waited 0.018s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:21 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d8c953-dddc-4cf6-99f2-166839962429]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:17:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1f3e0318-27ff-4e32-a972-4bd7d303da78 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-487bd106-dbc3-40e5-bc9f-a5144bfe84a9 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:21 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b4540fd7-3601-42eb-8270-513a9ef6294a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.361s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:21 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-b4540fd7-3601-42eb-8270-513a9ef6294a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:17:21 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-b4540fd7-3601-42eb-8270-513a9ef6294a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Deleted volume successfully. Jul 21 02:17:21 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b4540fd7-3601-42eb-8270-513a9ef6294a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "cinder-1a92330a-08d9-44bd-b6a0-591ed8f207f5-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:21 devstack sudo[100704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-487bd106-dbc3-40e5-bc9f-a5144bfe84a9 Jul 21 02:17:21 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:22 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1f3e0318-27ff-4e32-a972-4bd7d303da78 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-487bd106-dbc3-40e5-bc9f-a5144bfe84a9" returned: 0 in 0.468s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1f3e0318-27ff-4e32-a972-4bd7d303da78 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-487bd106-dbc3-40e5-bc9f-a5144bfe84a9 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:22 devstack sudo[100710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-487bd106-dbc3-40e5-bc9f-a5144bfe84a9 Jul 21 02:17:22 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:22 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1f3e0318-27ff-4e32-a972-4bd7d303da78 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-487bd106-dbc3-40e5-bc9f-a5144bfe84a9" returned: 0 in 0.338s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1f3e0318-27ff-4e32-a972-4bd7d303da78 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "cinder-quobyte-487bd106-dbc3-40e5-bc9f-a5144bfe84a9" released by "delete_volume" :: held 0.864s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:22 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-1f3e0318-27ff-4e32-a972-4bd7d303da78 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Created reservations ['911c0ddc-6c04-4f1d-976f-ab1fb81829a0', 'f7a37643-7e1b-4348-bc61-8bd02b13a090', '52523fb5-c933-416e-adff-cdb3a180fb52', '8e6d957c-4557-4680-af41-465cec7750d6'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:17:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-1f3e0318-27ff-4e32-a972-4bd7d303da78 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-1f3e0318-27ff-4e32-a972-4bd7d303da78 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:22 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-1f3e0318-27ff-4e32-a972-4bd7d303da78 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:17:22 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-1f3e0318-27ff-4e32-a972-4bd7d303da78 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:17:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-1f3e0318-27ff-4e32-a972-4bd7d303da78 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1f3e0318-27ff-4e32-a972-4bd7d303da78 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:22 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:17:22 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-83370600-1c76-4be9-b2b0-488a5d0b361c tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Acquiring lock "cinder-027e8b21-fcd4-4f9d-9eca-6aea01cd94bc-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-83370600-1c76-4be9-b2b0-488a5d0b361c tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "cinder-027e8b21-fcd4-4f9d-9eca-6aea01cd94bc-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-83370600-1c76-4be9-b2b0-488a5d0b361c tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Acquiring lock "cinder-quobyte-027e8b21-fcd4-4f9d-9eca-6aea01cd94bc" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-83370600-1c76-4be9-b2b0-488a5d0b361c tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "cinder-quobyte-027e8b21-fcd4-4f9d-9eca-6aea01cd94bc" acquired by "delete_volume" :: waited 0.036s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:22 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb500ef1-08f2-40c1-b4ef-cc16ef0c7326]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:17:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-83370600-1c76-4be9-b2b0-488a5d0b361c tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-027e8b21-fcd4-4f9d-9eca-6aea01cd94bc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:22 devstack sudo[100716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-027e8b21-fcd4-4f9d-9eca-6aea01cd94bc Jul 21 02:17:22 devstack sudo[100716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:23 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1f3e0318-27ff-4e32-a972-4bd7d303da78 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.432s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:23 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-1f3e0318-27ff-4e32-a972-4bd7d303da78 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:17:23 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-1f3e0318-27ff-4e32-a972-4bd7d303da78 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Deleted volume successfully. Jul 21 02:17:23 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1f3e0318-27ff-4e32-a972-4bd7d303da78 tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "cinder-487bd106-dbc3-40e5-bc9f-a5144bfe84a9-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:23 devstack sudo[100716]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-83370600-1c76-4be9-b2b0-488a5d0b361c tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-027e8b21-fcd4-4f9d-9eca-6aea01cd94bc" returned: 0 in 0.497s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-83370600-1c76-4be9-b2b0-488a5d0b361c tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-027e8b21-fcd4-4f9d-9eca-6aea01cd94bc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:23 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-027e8b21-fcd4-4f9d-9eca-6aea01cd94bc Jul 21 02:17:23 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:23 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-83370600-1c76-4be9-b2b0-488a5d0b361c tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-027e8b21-fcd4-4f9d-9eca-6aea01cd94bc" returned: 0 in 0.416s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:23 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-83370600-1c76-4be9-b2b0-488a5d0b361c tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "cinder-quobyte-027e8b21-fcd4-4f9d-9eca-6aea01cd94bc" released by "delete_volume" :: held 0.994s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:23 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-83370600-1c76-4be9-b2b0-488a5d0b361c tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Created reservations ['ce243024-ce9c-4d23-82b2-d4b170c0490a', '58f4842e-0e60-4ee1-9615-d663b150740e', 'f582b380-a93d-4782-a9a5-e282fbe2cf54', '528dbac6-3d6b-4d94-9c7e-f60d71293245'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:17:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-83370600-1c76-4be9-b2b0-488a5d0b361c tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-83370600-1c76-4be9-b2b0-488a5d0b361c tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:23 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-83370600-1c76-4be9-b2b0-488a5d0b361c tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:17:23 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-83370600-1c76-4be9-b2b0-488a5d0b361c tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:17:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-83370600-1c76-4be9-b2b0-488a5d0b361c tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-83370600-1c76-4be9-b2b0-488a5d0b361c tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:23 devstack sudo[100725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:17:23 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:24 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-83370600-1c76-4be9-b2b0-488a5d0b361c tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.319s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:24 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-83370600-1c76-4be9-b2b0-488a5d0b361c tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:17:24 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-83370600-1c76-4be9-b2b0-488a5d0b361c tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Deleted volume successfully. Jul 21 02:17:24 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-83370600-1c76-4be9-b2b0-488a5d0b361c tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "cinder-027e8b21-fcd4-4f9d-9eca-6aea01cd94bc-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:24 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:17:24 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] Flow 'volume_create_manager' (f16086ed-86c1-43e5-a745-300d3cde1cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:17:24 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ded9ea05-0f7b-4126-90e4-fa2401ac2cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:24 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ded9ea05-0f7b-4126-90e4-fa2401ac2cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1459073806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6215bed8-1673-4091-ab15-ca4977be749c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7c6821b1406247feae4bdaa81f56f6ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:17:25Z,use_quota=True,user_id='5af49c2c394c4d9e85571cd55f379b8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:24 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e020620-54a1-4717-90fb-76d06967f192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:24 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e020620-54a1-4717-90fb-76d06967f192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:24 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5611ce18-e6fd-4934-92af-c27ef7d68a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:24 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5611ce18-e6fd-4934-92af-c27ef7d68a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6215bed8-1673-4091-ab15-ca4977be749c', 'volume_name': 'volume-6215bed8-1673-4091-ab15-ca4977be749c', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:24 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4816ddb3-eece-44ca-92c2-2d73d3615e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:24 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4816ddb3-eece-44ca-92c2-2d73d3615e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:24 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ea1ca9a-7ede-4f46-b188-12742abb2491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:24 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] Volume 6215bed8-1673-4091-ab15-ca4977be749c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6215bed8-1673-4091-ab15-ca4977be749c', 'volume_size': 1} Jul 21 02:17:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:24 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1459073806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6215bed8-1673-4091-ab15-ca4977be749c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7c6821b1406247feae4bdaa81f56f6ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:17:25Z,use_quota=True,user_id='5af49c2c394c4d9e85571cd55f379b8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:17:24 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] Creating volume 6215bed8-1673-4091-ab15-ca4977be749c {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:17:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:24 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:17:24 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:17:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:24 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:17:24 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:17:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6215bed8-1673-4091-ab15-ca4977be749c 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:24 devstack sudo[100728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6215bed8-1673-4091-ab15-ca4977be749c 1073741824 Jul 21 02:17:24 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:25 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-91fbaa79-d0bb-4b9d-ace5-58c86a7f638a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Acquiring lock "cinder-7ff3e0b8-eeff-4951-b76e-88fc8875fc31-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:25 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-91fbaa79-d0bb-4b9d-ace5-58c86a7f638a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "cinder-7ff3e0b8-eeff-4951-b76e-88fc8875fc31-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:25 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-91fbaa79-d0bb-4b9d-ace5-58c86a7f638a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Acquiring lock "cinder-quobyte-7ff3e0b8-eeff-4951-b76e-88fc8875fc31" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:25 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-91fbaa79-d0bb-4b9d-ace5-58c86a7f638a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "cinder-quobyte-7ff3e0b8-eeff-4951-b76e-88fc8875fc31" acquired by "delete_volume" :: waited 0.024s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:25 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[8171f127-9309-4921-b766-b97a1c8a7686]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:17:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91fbaa79-d0bb-4b9d-ace5-58c86a7f638a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7ff3e0b8-eeff-4951-b76e-88fc8875fc31 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:25 devstack sudo[100730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7ff3e0b8-eeff-4951-b76e-88fc8875fc31 Jul 21 02:17:25 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:25 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:25 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6215bed8-1673-4091-ab15-ca4977be749c 1073741824" returned: 0 in 0.779s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91fbaa79-d0bb-4b9d-ace5-58c86a7f638a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7ff3e0b8-eeff-4951-b76e-88fc8875fc31" returned: 0 in 0.484s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91fbaa79-d0bb-4b9d-ace5-58c86a7f638a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7ff3e0b8-eeff-4951-b76e-88fc8875fc31 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:25 devstack sudo[100739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7ff3e0b8-eeff-4951-b76e-88fc8875fc31 Jul 21 02:17:25 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6215bed8-1673-4091-ab15-ca4977be749c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:25 devstack sudo[100741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6215bed8-1673-4091-ab15-ca4977be749c Jul 21 02:17:25 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:26 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91fbaa79-d0bb-4b9d-ace5-58c86a7f638a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7ff3e0b8-eeff-4951-b76e-88fc8875fc31" returned: 0 in 0.318s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:26 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-91fbaa79-d0bb-4b9d-ace5-58c86a7f638a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "cinder-quobyte-7ff3e0b8-eeff-4951-b76e-88fc8875fc31" released by "delete_volume" :: held 0.876s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:26 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6215bed8-1673-4091-ab15-ca4977be749c" returned: 0 in 0.312s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:26 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:17:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:26 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ea1ca9a-7ede-4f46-b188-12742abb2491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6215bed8-1673-4091-ab15-ca4977be749c', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:26 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5426e4e9-28c9-442b-8156-7f7840233fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:26 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] Volume volume-6215bed8-1673-4091-ab15-ca4977be749c (6215bed8-1673-4091-ab15-ca4977be749c): created successfully Jul 21 02:17:26 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5426e4e9-28c9-442b-8156-7f7840233fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:26 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] Flow 'volume_create_manager' (f16086ed-86c1-43e5-a745-300d3cde1cb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:17:26 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-91fbaa79-d0bb-4b9d-ace5-58c86a7f638a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Created reservations ['945e095e-d9ee-443b-9683-2586c1181ccf', '4dfd4bb6-9c8d-4b74-a30b-fc4dd63b5ff6', 'e8e17c91-762c-4265-a4f1-f0bd73de3e03', 'f39ee4df-7ba8-4a30-bbf9-0195e5c0686f'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:17:26 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-83e3143a-7673-49f8-af0b-351f7af50c36 tempest-VolumesListTestJSON-834702630 None] Created volume successfully. Jul 21 02:17:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-91fbaa79-d0bb-4b9d-ace5-58c86a7f638a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-91fbaa79-d0bb-4b9d-ace5-58c86a7f638a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:26 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-91fbaa79-d0bb-4b9d-ace5-58c86a7f638a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:17:26 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-91fbaa79-d0bb-4b9d-ace5-58c86a7f638a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:17:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-91fbaa79-d0bb-4b9d-ace5-58c86a7f638a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91fbaa79-d0bb-4b9d-ace5-58c86a7f638a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:26 devstack sudo[100745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:17:26 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:26 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91fbaa79-d0bb-4b9d-ace5-58c86a7f638a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.278s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:26 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-91fbaa79-d0bb-4b9d-ace5-58c86a7f638a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:17:26 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-91fbaa79-d0bb-4b9d-ace5-58c86a7f638a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Deleted volume successfully. Jul 21 02:17:26 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-91fbaa79-d0bb-4b9d-ace5-58c86a7f638a tempest-CreateVolumesFromSourceVolumeTest-1388800398 None] Lock "cinder-7ff3e0b8-eeff-4951-b76e-88fc8875fc31-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:27 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:17:27 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] Flow 'volume_create_manager' (2ae36f52-287d-409e-8538-af29ae2bdf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:17:27 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (503679a7-51a0-423d-88c6-2da7559a9069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:27 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (503679a7-51a0-423d-88c6-2da7559a9069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1959521546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6de219f-6ba5-4506-abaa-b4279095418e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7c6821b1406247feae4bdaa81f56f6ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:17:28Z,use_quota=True,user_id='5af49c2c394c4d9e85571cd55f379b8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:27 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3956ee64-71f5-4a8c-9361-6583b044cabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:27 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3956ee64-71f5-4a8c-9361-6583b044cabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:27 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2eedb28-63bf-45c0-a028-e287016f7b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:27 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2eedb28-63bf-45c0-a028-e287016f7b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6de219f-6ba5-4506-abaa-b4279095418e', 'volume_name': 'volume-e6de219f-6ba5-4506-abaa-b4279095418e', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:27 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f13a43-be30-41a6-a5b3-0cedddfe981c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:27 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f13a43-be30-41a6-a5b3-0cedddfe981c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:27 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1666cece-d8e9-4804-8e38-940a153a7f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:27 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] Volume e6de219f-6ba5-4506-abaa-b4279095418e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6de219f-6ba5-4506-abaa-b4279095418e', 'volume_size': 1} Jul 21 02:17:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:27 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1959521546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6de219f-6ba5-4506-abaa-b4279095418e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7c6821b1406247feae4bdaa81f56f6ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:17:28Z,use_quota=True,user_id='5af49c2c394c4d9e85571cd55f379b8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:17:27 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] Creating volume e6de219f-6ba5-4506-abaa-b4279095418e {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:17:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:27 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:17:27 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:17:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:27 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:17:27 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:17:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e6de219f-6ba5-4506-abaa-b4279095418e 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:27 devstack sudo[100748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e6de219f-6ba5-4506-abaa-b4279095418e 1073741824 Jul 21 02:17:27 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:28 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e6de219f-6ba5-4506-abaa-b4279095418e 1073741824" returned: 0 in 0.493s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e6de219f-6ba5-4506-abaa-b4279095418e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:28 devstack sudo[100753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e6de219f-6ba5-4506-abaa-b4279095418e Jul 21 02:17:28 devstack sudo[100753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:28 devstack sudo[100753]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e6de219f-6ba5-4506-abaa-b4279095418e" returned: 0 in 0.271s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:28 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:17:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:28 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1666cece-d8e9-4804-8e38-940a153a7f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6de219f-6ba5-4506-abaa-b4279095418e', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:28 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cee1876-f15f-43b5-b741-2469bf21bb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:28 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] Volume volume-e6de219f-6ba5-4506-abaa-b4279095418e (e6de219f-6ba5-4506-abaa-b4279095418e): created successfully Jul 21 02:17:28 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cee1876-f15f-43b5-b741-2469bf21bb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:28 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] Flow 'volume_create_manager' (2ae36f52-287d-409e-8538-af29ae2bdf21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:17:28 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-09f45a06-5bfe-4b15-a85e-a453a74f1dcd tempest-VolumesListTestJSON-834702630 None] Created volume successfully. Jul 21 02:17:30 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:17:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] Flow 'volume_create_manager' (c89e29f0-271c-43e6-bbf3-f4e3be490880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:17:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64cad6e4-03ca-41d3-8e50-aa526e5c8489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64cad6e4-03ca-41d3-8e50-aa526e5c8489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1670820638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2709291c-75c6-4718-b642-7ceeaab77309,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7c6821b1406247feae4bdaa81f56f6ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:17:30Z,use_quota=True,user_id='5af49c2c394c4d9e85571cd55f379b8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4db0683-add2-466a-b6d3-e6659f281670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4db0683-add2-466a-b6d3-e6659f281670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (352e2c7a-2466-4c2c-a6b9-daab83589b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (352e2c7a-2466-4c2c-a6b9-daab83589b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2709291c-75c6-4718-b642-7ceeaab77309', 'volume_name': 'volume-2709291c-75c6-4718-b642-7ceeaab77309', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (825c5d2e-057b-4597-8784-517663c67eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (825c5d2e-057b-4597-8784-517663c67eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2caf7494-9026-4336-9f96-7cfa613b48ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:30 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] Volume 2709291c-75c6-4718-b642-7ceeaab77309: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2709291c-75c6-4718-b642-7ceeaab77309', 'volume_size': 1} Jul 21 02:17:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:30 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1670820638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2709291c-75c6-4718-b642-7ceeaab77309,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7c6821b1406247feae4bdaa81f56f6ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:17:30Z,use_quota=True,user_id='5af49c2c394c4d9e85571cd55f379b8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:17:30 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] Creating volume 2709291c-75c6-4718-b642-7ceeaab77309 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:17:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:30 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:17:30 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:17:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:30 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:17:30 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:17:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2709291c-75c6-4718-b642-7ceeaab77309 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:30 devstack sudo[100758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2709291c-75c6-4718-b642-7ceeaab77309 1073741824 Jul 21 02:17:30 devstack sudo[100758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:31 devstack sudo[100758]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2709291c-75c6-4718-b642-7ceeaab77309 1073741824" returned: 0 in 0.654s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2709291c-75c6-4718-b642-7ceeaab77309 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:31 devstack sudo[100763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2709291c-75c6-4718-b642-7ceeaab77309 Jul 21 02:17:31 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:31 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2709291c-75c6-4718-b642-7ceeaab77309" returned: 0 in 0.432s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:31 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:17:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:31 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2caf7494-9026-4336-9f96-7cfa613b48ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2709291c-75c6-4718-b642-7ceeaab77309', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:31 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d21e3d5-ac16-47e7-bf6e-2d8d500f0451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:31 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] Volume volume-2709291c-75c6-4718-b642-7ceeaab77309 (2709291c-75c6-4718-b642-7ceeaab77309): created successfully Jul 21 02:17:31 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d21e3d5-ac16-47e7-bf6e-2d8d500f0451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:31 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] Flow 'volume_create_manager' (c89e29f0-271c-43e6-bbf3-f4e3be490880) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:17:31 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-de2a44c5-4057-47d7-8845-fd4257010adc tempest-VolumesListTestJSON-834702630 None] Created volume successfully. Jul 21 02:17:35 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d6f813f4-5c9d-4670-9378-a120824b3169 tempest-VolumesListTestJSON-834702630 None] Acquiring lock "cinder-2709291c-75c6-4718-b642-7ceeaab77309-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:35 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d6f813f4-5c9d-4670-9378-a120824b3169 tempest-VolumesListTestJSON-834702630 None] Lock "cinder-2709291c-75c6-4718-b642-7ceeaab77309-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:35 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d6f813f4-5c9d-4670-9378-a120824b3169 tempest-VolumesListTestJSON-834702630 None] Acquiring lock "cinder-quobyte-2709291c-75c6-4718-b642-7ceeaab77309" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:35 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d6f813f4-5c9d-4670-9378-a120824b3169 tempest-VolumesListTestJSON-834702630 None] Lock "cinder-quobyte-2709291c-75c6-4718-b642-7ceeaab77309" acquired by "delete_volume" :: waited 0.024s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:35 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4613a4-a529-4463-b78a-03dc677edca5]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:17:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d6f813f4-5c9d-4670-9378-a120824b3169 tempest-VolumesListTestJSON-834702630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2709291c-75c6-4718-b642-7ceeaab77309 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:35 devstack sudo[100767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2709291c-75c6-4718-b642-7ceeaab77309 Jul 21 02:17:35 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:35 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d6f813f4-5c9d-4670-9378-a120824b3169 tempest-VolumesListTestJSON-834702630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2709291c-75c6-4718-b642-7ceeaab77309" returned: 0 in 0.443s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d6f813f4-5c9d-4670-9378-a120824b3169 tempest-VolumesListTestJSON-834702630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2709291c-75c6-4718-b642-7ceeaab77309 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:35 devstack sudo[100772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2709291c-75c6-4718-b642-7ceeaab77309 Jul 21 02:17:35 devstack sudo[100772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:36 devstack sudo[100772]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d6f813f4-5c9d-4670-9378-a120824b3169 tempest-VolumesListTestJSON-834702630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2709291c-75c6-4718-b642-7ceeaab77309" returned: 0 in 0.291s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:36 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d6f813f4-5c9d-4670-9378-a120824b3169 tempest-VolumesListTestJSON-834702630 None] Lock "cinder-quobyte-2709291c-75c6-4718-b642-7ceeaab77309" released by "delete_volume" :: held 0.798s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:36 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-d6f813f4-5c9d-4670-9378-a120824b3169 tempest-VolumesListTestJSON-834702630 None] Created reservations ['19672ed1-e816-44d5-8473-e855ca50f41d', '85d4f977-dd3b-414d-89dc-62b16ff83840', 'd697aa4d-796c-4512-be8b-99c2d01164dd', '0daf471c-3e6c-4f8e-b3bc-2001a1fdb5f5'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:17:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d6f813f4-5c9d-4670-9378-a120824b3169 tempest-VolumesListTestJSON-834702630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d6f813f4-5c9d-4670-9378-a120824b3169 tempest-VolumesListTestJSON-834702630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:36 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d6f813f4-5c9d-4670-9378-a120824b3169 tempest-VolumesListTestJSON-834702630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:17:36 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d6f813f4-5c9d-4670-9378-a120824b3169 tempest-VolumesListTestJSON-834702630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:17:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d6f813f4-5c9d-4670-9378-a120824b3169 tempest-VolumesListTestJSON-834702630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d6f813f4-5c9d-4670-9378-a120824b3169 tempest-VolumesListTestJSON-834702630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:36 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:17:36 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:36 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c156986a-b44a-493e-8f5f-25993479a555 tempest-VolumesListTestJSON-834702630 None] Acquiring lock "cinder-e6de219f-6ba5-4506-abaa-b4279095418e-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:36 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:36 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c156986a-b44a-493e-8f5f-25993479a555 tempest-VolumesListTestJSON-834702630 None] Lock "cinder-e6de219f-6ba5-4506-abaa-b4279095418e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d6f813f4-5c9d-4670-9378-a120824b3169 tempest-VolumesListTestJSON-834702630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.308s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:36 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-d6f813f4-5c9d-4670-9378-a120824b3169 tempest-VolumesListTestJSON-834702630 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:17:36 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-d6f813f4-5c9d-4670-9378-a120824b3169 tempest-VolumesListTestJSON-834702630 None] Deleted volume successfully. Jul 21 02:17:36 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c156986a-b44a-493e-8f5f-25993479a555 tempest-VolumesListTestJSON-834702630 None] Acquiring lock "cinder-quobyte-e6de219f-6ba5-4506-abaa-b4279095418e" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:36 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d6f813f4-5c9d-4670-9378-a120824b3169 tempest-VolumesListTestJSON-834702630 None] Lock "cinder-2709291c-75c6-4718-b642-7ceeaab77309-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:36 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c156986a-b44a-493e-8f5f-25993479a555 tempest-VolumesListTestJSON-834702630 None] Lock "cinder-quobyte-e6de219f-6ba5-4506-abaa-b4279095418e" acquired by "delete_volume" :: waited 0.026s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:36 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[37316d7e-4a1b-47a0-baa9-4095c10af589]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:17:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c156986a-b44a-493e-8f5f-25993479a555 tempest-VolumesListTestJSON-834702630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e6de219f-6ba5-4506-abaa-b4279095418e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:36 devstack sudo[100778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e6de219f-6ba5-4506-abaa-b4279095418e Jul 21 02:17:36 devstack sudo[100778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:37 devstack sudo[100778]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c156986a-b44a-493e-8f5f-25993479a555 tempest-VolumesListTestJSON-834702630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e6de219f-6ba5-4506-abaa-b4279095418e" returned: 0 in 0.421s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c156986a-b44a-493e-8f5f-25993479a555 tempest-VolumesListTestJSON-834702630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e6de219f-6ba5-4506-abaa-b4279095418e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:37 devstack sudo[100784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e6de219f-6ba5-4506-abaa-b4279095418e Jul 21 02:17:37 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:37 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c156986a-b44a-493e-8f5f-25993479a555 tempest-VolumesListTestJSON-834702630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e6de219f-6ba5-4506-abaa-b4279095418e" returned: 0 in 0.277s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:37 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c156986a-b44a-493e-8f5f-25993479a555 tempest-VolumesListTestJSON-834702630 None] Lock "cinder-quobyte-e6de219f-6ba5-4506-abaa-b4279095418e" released by "delete_volume" :: held 0.758s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:37 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-c156986a-b44a-493e-8f5f-25993479a555 tempest-VolumesListTestJSON-834702630 None] Created reservations ['fa73030a-b5bb-448d-84eb-c1a1482fd387', '8107db6a-7e13-4876-a59b-7900be995b01', '961209a4-6acf-4cf1-b35d-f40b0965d7d1', '865ac03b-a387-4ead-9300-18961e276520'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:17:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c156986a-b44a-493e-8f5f-25993479a555 tempest-VolumesListTestJSON-834702630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c156986a-b44a-493e-8f5f-25993479a555 tempest-VolumesListTestJSON-834702630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:37 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c156986a-b44a-493e-8f5f-25993479a555 tempest-VolumesListTestJSON-834702630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:17:37 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c156986a-b44a-493e-8f5f-25993479a555 tempest-VolumesListTestJSON-834702630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:17:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c156986a-b44a-493e-8f5f-25993479a555 tempest-VolumesListTestJSON-834702630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c156986a-b44a-493e-8f5f-25993479a555 tempest-VolumesListTestJSON-834702630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:37 devstack sudo[100787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:17:37 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:37 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-98bb832a-253b-4bf9-be45-9c767b32f7ba tempest-VolumesListTestJSON-834702630 None] Acquiring lock "cinder-6215bed8-1673-4091-ab15-ca4977be749c-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:37 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c156986a-b44a-493e-8f5f-25993479a555 tempest-VolumesListTestJSON-834702630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.322s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:37 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-c156986a-b44a-493e-8f5f-25993479a555 tempest-VolumesListTestJSON-834702630 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:17:37 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-98bb832a-253b-4bf9-be45-9c767b32f7ba tempest-VolumesListTestJSON-834702630 None] Lock "cinder-6215bed8-1673-4091-ab15-ca4977be749c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:37 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-c156986a-b44a-493e-8f5f-25993479a555 tempest-VolumesListTestJSON-834702630 None] Deleted volume successfully. Jul 21 02:17:37 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c156986a-b44a-493e-8f5f-25993479a555 tempest-VolumesListTestJSON-834702630 None] Lock "cinder-e6de219f-6ba5-4506-abaa-b4279095418e-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:37 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-98bb832a-253b-4bf9-be45-9c767b32f7ba tempest-VolumesListTestJSON-834702630 None] Acquiring lock "cinder-quobyte-6215bed8-1673-4091-ab15-ca4977be749c" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:17:38 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-98bb832a-253b-4bf9-be45-9c767b32f7ba tempest-VolumesListTestJSON-834702630 None] Lock "cinder-quobyte-6215bed8-1673-4091-ab15-ca4977be749c" acquired by "delete_volume" :: waited 0.015s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:17:38 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[41395e8d-c8e6-45f9-a594-05c08deca4ee]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:17:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-98bb832a-253b-4bf9-be45-9c767b32f7ba tempest-VolumesListTestJSON-834702630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6215bed8-1673-4091-ab15-ca4977be749c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:38 devstack sudo[100790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6215bed8-1673-4091-ab15-ca4977be749c Jul 21 02:17:38 devstack sudo[100790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:38 devstack sudo[100790]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-98bb832a-253b-4bf9-be45-9c767b32f7ba tempest-VolumesListTestJSON-834702630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6215bed8-1673-4091-ab15-ca4977be749c" returned: 0 in 0.395s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-98bb832a-253b-4bf9-be45-9c767b32f7ba tempest-VolumesListTestJSON-834702630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6215bed8-1673-4091-ab15-ca4977be749c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:38 devstack sudo[100795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6215bed8-1673-4091-ab15-ca4977be749c Jul 21 02:17:38 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:38 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-98bb832a-253b-4bf9-be45-9c767b32f7ba tempest-VolumesListTestJSON-834702630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6215bed8-1673-4091-ab15-ca4977be749c" returned: 0 in 0.275s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:38 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-98bb832a-253b-4bf9-be45-9c767b32f7ba tempest-VolumesListTestJSON-834702630 None] Lock "cinder-quobyte-6215bed8-1673-4091-ab15-ca4977be749c" released by "delete_volume" :: held 0.723s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:38 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-98bb832a-253b-4bf9-be45-9c767b32f7ba tempest-VolumesListTestJSON-834702630 None] Created reservations ['d82fbbd8-1703-4752-8fd1-530590534d72', 'ed4882fc-360d-41e6-adfa-f8ec86379732', 'f3106c5f-b828-45c9-9ddf-ae1441fb32ab', '85050aa5-307a-48c8-bb2c-ebe12b733739'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:17:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-98bb832a-253b-4bf9-be45-9c767b32f7ba tempest-VolumesListTestJSON-834702630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-98bb832a-253b-4bf9-be45-9c767b32f7ba tempest-VolumesListTestJSON-834702630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:38 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-98bb832a-253b-4bf9-be45-9c767b32f7ba tempest-VolumesListTestJSON-834702630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:17:38 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-98bb832a-253b-4bf9-be45-9c767b32f7ba tempest-VolumesListTestJSON-834702630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:17:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-98bb832a-253b-4bf9-be45-9c767b32f7ba tempest-VolumesListTestJSON-834702630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-98bb832a-253b-4bf9-be45-9c767b32f7ba tempest-VolumesListTestJSON-834702630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:38 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:17:38 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:39 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-98bb832a-253b-4bf9-be45-9c767b32f7ba tempest-VolumesListTestJSON-834702630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.338s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:39 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-98bb832a-253b-4bf9-be45-9c767b32f7ba tempest-VolumesListTestJSON-834702630 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:17:39 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-98bb832a-253b-4bf9-be45-9c767b32f7ba tempest-VolumesListTestJSON-834702630 None] Deleted volume successfully. Jul 21 02:17:39 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-98bb832a-253b-4bf9-be45-9c767b32f7ba tempest-VolumesListTestJSON-834702630 None] Lock "cinder-6215bed8-1673-4091-ab15-ca4977be749c-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:17:45 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:17:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] Flow 'volume_create_manager' (3dc495e2-dad7-49b0-9525-18dc56c64d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:17:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c14a74e-e60a-47dc-827b-0fc208bfb6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c14a74e-e60a-47dc-827b-0fc208bfb6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-276037574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aaf0976-7a35-4722-a023-5345d674cf30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f104d9e2d44245b6a4d5183a12d9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:17:46Z,use_quota=True,user_id='8c24d3fa13ac4d49829aa3f60307b285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7d8043c-455f-4625-bb84-f9599755acb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7d8043c-455f-4625-bb84-f9599755acb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3152a75d-3d71-4642-b7db-679370d72616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3152a75d-3d71-4642-b7db-679370d72616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aaf0976-7a35-4722-a023-5345d674cf30', 'volume_name': 'volume-6aaf0976-7a35-4722-a023-5345d674cf30', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87057ee6-b2b9-45a8-bc89-ff416ac8fe42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87057ee6-b2b9-45a8-bc89-ff416ac8fe42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689abc05-4eff-484a-b569-b33ddc3ed6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:46 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] Volume 6aaf0976-7a35-4722-a023-5345d674cf30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aaf0976-7a35-4722-a023-5345d674cf30', 'volume_size': 1} Jul 21 02:17:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-276037574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aaf0976-7a35-4722-a023-5345d674cf30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f104d9e2d44245b6a4d5183a12d9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:17:46Z,use_quota=True,user_id='8c24d3fa13ac4d49829aa3f60307b285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:17:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] Creating volume 6aaf0976-7a35-4722-a023-5345d674cf30 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:17:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:17:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:17:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:17:46 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:17:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6aaf0976-7a35-4722-a023-5345d674cf30 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:46 devstack sudo[100802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6aaf0976-7a35-4722-a023-5345d674cf30 1073741824 Jul 21 02:17:46 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:46 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6aaf0976-7a35-4722-a023-5345d674cf30 1073741824" returned: 0 in 0.595s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6aaf0976-7a35-4722-a023-5345d674cf30 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:46 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6aaf0976-7a35-4722-a023-5345d674cf30 Jul 21 02:17:46 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:47 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6aaf0976-7a35-4722-a023-5345d674cf30" returned: 0 in 0.303s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:47 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:17:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689abc05-4eff-484a-b569-b33ddc3ed6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aaf0976-7a35-4722-a023-5345d674cf30', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4652c7a3-6600-4356-b651-b8a34c4383e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:47 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] Volume volume-6aaf0976-7a35-4722-a023-5345d674cf30 (6aaf0976-7a35-4722-a023-5345d674cf30): created successfully Jul 21 02:17:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4652c7a3-6600-4356-b651-b8a34c4383e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] Flow 'volume_create_manager' (3dc495e2-dad7-49b0-9525-18dc56c64d71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:17:47 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-8353300b-ee82-46de-9b8c-63125b620f07 tempest-VolumesNegativeTest-1952664003 None] Created volume successfully. Jul 21 02:17:48 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:17:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:17:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:17:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:48 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:17:48 devstack sudo[100815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:17:48 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] Flow 'volume_create_manager' (273e965c-fa8b-40c1-aa03-ac7838d3a71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:17:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a66c0d68-fde9-4cdd-88cb-62294f58c908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a66c0d68-fde9-4cdd-88cb-62294f58c908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-725489931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c92112c5-c00c-4d35-aa48-cc26137d87f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b33c6b244b40f19f3587e245222e3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:17:49Z,use_quota=True,user_id='9c7e45b420984ff4ae96ce56dd723c5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64a5dd5e-9d97-4600-b894-90a99fb1de21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64a5dd5e-9d97-4600-b894-90a99fb1de21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56939f50-ab74-4744-9ec8-0ed07cf54178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56939f50-ab74-4744-9ec8-0ed07cf54178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c92112c5-c00c-4d35-aa48-cc26137d87f5', 'volume_name': 'volume-c92112c5-c00c-4d35-aa48-cc26137d87f5', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf03202-a9ee-4e3c-a2ac-e3ed9c282ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf03202-a9ee-4e3c-a2ac-e3ed9c282ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a6f493a-77d9-4a53-b5f4-c48442435331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:49 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] Volume c92112c5-c00c-4d35-aa48-cc26137d87f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c92112c5-c00c-4d35-aa48-cc26137d87f5', 'volume_size': 1} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-725489931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c92112c5-c00c-4d35-aa48-cc26137d87f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b33c6b244b40f19f3587e245222e3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:17:49Z,use_quota=True,user_id='9c7e45b420984ff4ae96ce56dd723c5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] Creating volume c92112c5-c00c-4d35-aa48-cc26137d87f5 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:17:49 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c92112c5-c00c-4d35-aa48-cc26137d87f5 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:49 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c92112c5-c00c-4d35-aa48-cc26137d87f5 1073741824 Jul 21 02:17:49 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:49 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.660s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager._thread_info {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread count: 28 {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread info: [<_MainThread(MainThread, started 135786703114368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] Flow 'volume_create_manager' (104c6224-a165-4df2-ba2f-894b97c8e8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e7703e-2260-44f4-ad72-a2728d0d6c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e7703e-2260-44f4-ad72-a2728d0d6c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-241782257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e274fb9-a1c7-410c-abe3-37c8b3e0e716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b33c6b244b40f19f3587e245222e3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:17:50Z,use_quota=True,user_id='9c7e45b420984ff4ae96ce56dd723c5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d4fe932-f351-429d-a509-bcdfcf9f2fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d4fe932-f351-429d-a509-bcdfcf9f2fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b7243ef-aa4e-4812-8fb7-786719147949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b7243ef-aa4e-4812-8fb7-786719147949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e274fb9-a1c7-410c-abe3-37c8b3e0e716', 'volume_name': 'volume-5e274fb9-a1c7-410c-abe3-37c8b3e0e716', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09bf2db9-e789-4cfa-bc94-3abb829c24f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09bf2db9-e789-4cfa-bc94-3abb829c24f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae1386d6-e65f-4218-ac63-a462e45a7e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:49 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] Volume 5e274fb9-a1c7-410c-abe3-37c8b3e0e716: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e274fb9-a1c7-410c-abe3-37c8b3e0e716', 'volume_size': 1} Jul 21 02:17:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:50 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c92112c5-c00c-4d35-aa48-cc26137d87f5 1073741824" returned: 0 in 0.977s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c92112c5-c00c-4d35-aa48-cc26137d87f5 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:50 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c92112c5-c00c-4d35-aa48-cc26137d87f5 Jul 21 02:17:50 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:50 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c92112c5-c00c-4d35-aa48-cc26137d87f5" returned: 0 in 0.577s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:17:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.757s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-241782257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e274fb9-a1c7-410c-abe3-37c8b3e0e716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b33c6b244b40f19f3587e245222e3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:17:50Z,use_quota=True,user_id='9c7e45b420984ff4ae96ce56dd723c5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:17:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] Creating volume 5e274fb9-a1c7-410c-abe3-37c8b3e0e716 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:17:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:17:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:17:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:17:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:17:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:17:50 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:17:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5e274fb9-a1c7-410c-abe3-37c8b3e0e716 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:50 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a6f493a-77d9-4a53-b5f4-c48442435331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c92112c5-c00c-4d35-aa48-cc26137d87f5', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:50 devstack sudo[100838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5e274fb9-a1c7-410c-abe3-37c8b3e0e716 1073741824 Jul 21 02:17:50 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:50 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (641e226e-140c-4e3f-a56d-7508196c565e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:50 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] Volume volume-c92112c5-c00c-4d35-aa48-cc26137d87f5 (c92112c5-c00c-4d35-aa48-cc26137d87f5): created successfully Jul 21 02:17:50 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (641e226e-140c-4e3f-a56d-7508196c565e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:50 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] Flow 'volume_create_manager' (273e965c-fa8b-40c1-aa03-ac7838d3a71d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:17:50 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-95a03bcd-1ca1-443f-911f-4c9f400d8c9d tempest-TestServerVolumeAttachmentScenario-159704105 None] Created volume successfully. Jul 21 02:17:51 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5e274fb9-a1c7-410c-abe3-37c8b3e0e716 1073741824" returned: 0 in 0.815s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5e274fb9-a1c7-410c-abe3-37c8b3e0e716 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:17:51 devstack sudo[100853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5e274fb9-a1c7-410c-abe3-37c8b3e0e716 Jul 21 02:17:51 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:17:51 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root Jul 21 02:17:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5e274fb9-a1c7-410c-abe3-37c8b3e0e716" returned: 0 in 0.342s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:17:51 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:17:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:17:52 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae1386d6-e65f-4218-ac63-a462e45a7e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e274fb9-a1c7-410c-abe3-37c8b3e0e716', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:52 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62bb170d-4796-4449-8200-9acc524340ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:17:52 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] Volume volume-5e274fb9-a1c7-410c-abe3-37c8b3e0e716 (5e274fb9-a1c7-410c-abe3-37c8b3e0e716): created successfully Jul 21 02:17:52 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62bb170d-4796-4449-8200-9acc524340ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:17:52 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] Flow 'volume_create_manager' (104c6224-a165-4df2-ba2f-894b97c8e8e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:17:52 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-74181114-2f4f-4551-a6ea-a72128a5303d tempest-TestServerVolumeAttachmentScenario-159704105 None] Created volume successfully. Jul 21 02:18:02 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=41,cinder:INSERT=20,cinder:UPDATE=78,cinder:DELETE=8 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:18:02 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:INSERT=14,cinder:UPDATE=69,cinder:SELECT=49,cinder:DELETE=5 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:18:14 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2ef67a87-dd90-4965-8831-15dd87e5abe7 tempest-VolumesNegativeTest-1952664003 None] Acquiring lock "cinder-6aaf0976-7a35-4722-a023-5345d674cf30-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:18:15 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2ef67a87-dd90-4965-8831-15dd87e5abe7 tempest-VolumesNegativeTest-1952664003 None] Lock "cinder-6aaf0976-7a35-4722-a023-5345d674cf30-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:18:15 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2ef67a87-dd90-4965-8831-15dd87e5abe7 tempest-VolumesNegativeTest-1952664003 None] Acquiring lock "cinder-quobyte-6aaf0976-7a35-4722-a023-5345d674cf30" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:18:15 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2ef67a87-dd90-4965-8831-15dd87e5abe7 tempest-VolumesNegativeTest-1952664003 None] Lock "cinder-quobyte-6aaf0976-7a35-4722-a023-5345d674cf30" acquired by "delete_volume" :: waited 0.025s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:18:15 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[45290451-02b0-4c69-8a2c-6da1c1548975]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:18:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2ef67a87-dd90-4965-8831-15dd87e5abe7 tempest-VolumesNegativeTest-1952664003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6aaf0976-7a35-4722-a023-5345d674cf30 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:15 devstack sudo[101190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6aaf0976-7a35-4722-a023-5345d674cf30 Jul 21 02:18:15 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:15 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2ef67a87-dd90-4965-8831-15dd87e5abe7 tempest-VolumesNegativeTest-1952664003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6aaf0976-7a35-4722-a023-5345d674cf30" returned: 0 in 0.359s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2ef67a87-dd90-4965-8831-15dd87e5abe7 tempest-VolumesNegativeTest-1952664003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6aaf0976-7a35-4722-a023-5345d674cf30 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:15 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6aaf0976-7a35-4722-a023-5345d674cf30 Jul 21 02:18:15 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:15 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2ef67a87-dd90-4965-8831-15dd87e5abe7 tempest-VolumesNegativeTest-1952664003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6aaf0976-7a35-4722-a023-5345d674cf30" returned: 0 in 0.246s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:15 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2ef67a87-dd90-4965-8831-15dd87e5abe7 tempest-VolumesNegativeTest-1952664003 None] Lock "cinder-quobyte-6aaf0976-7a35-4722-a023-5345d674cf30" released by "delete_volume" :: held 0.652s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:18:15 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-2ef67a87-dd90-4965-8831-15dd87e5abe7 tempest-VolumesNegativeTest-1952664003 None] Created reservations ['bc3216c2-f68c-48f3-8419-7550d9fa9a5b', 'e6269d17-9616-4ec2-a846-2f4203df0143', '339f792b-83d3-469a-963b-1f6039f9dec9', '051a4699-1ee8-4980-804b-335d8d052dc0'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:18:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2ef67a87-dd90-4965-8831-15dd87e5abe7 tempest-VolumesNegativeTest-1952664003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:18:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2ef67a87-dd90-4965-8831-15dd87e5abe7 tempest-VolumesNegativeTest-1952664003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:18:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2ef67a87-dd90-4965-8831-15dd87e5abe7 tempest-VolumesNegativeTest-1952664003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:18:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2ef67a87-dd90-4965-8831-15dd87e5abe7 tempest-VolumesNegativeTest-1952664003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:18:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2ef67a87-dd90-4965-8831-15dd87e5abe7 tempest-VolumesNegativeTest-1952664003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:18:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2ef67a87-dd90-4965-8831-15dd87e5abe7 tempest-VolumesNegativeTest-1952664003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:15 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:18:15 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:16 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2ef67a87-dd90-4965-8831-15dd87e5abe7 tempest-VolumesNegativeTest-1952664003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.284s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:16 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-2ef67a87-dd90-4965-8831-15dd87e5abe7 tempest-VolumesNegativeTest-1952664003 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:18:16 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-2ef67a87-dd90-4965-8831-15dd87e5abe7 tempest-VolumesNegativeTest-1952664003 None] Deleted volume successfully. Jul 21 02:18:16 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2ef67a87-dd90-4965-8831-15dd87e5abe7 tempest-VolumesNegativeTest-1952664003 None] Lock "cinder-6aaf0976-7a35-4722-a023-5345d674cf30-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:18:23 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:18:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Flow 'volume_create_manager' (b3c7da42-ce9a-4550-9cd1-7809f177bc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:18:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bab0186-5b60-4e41-ac80-d8b39b9f1b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bab0186-5b60-4e41-ac80-d8b39b9f1b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1907138081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fec9d9f-d08a-4901-8830-0498e986d4f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4e9443bc0b4fc4b1a0e0262c92d685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:18:24Z,use_quota=True,user_id='a010233373884346ad1545e1185f40a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3caee63-2889-42af-ad7a-a5722a59cea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3caee63-2889-42af-ad7a-a5722a59cea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c81e76ed-6291-4c26-93d1-0d91c597c78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c81e76ed-6291-4c26-93d1-0d91c597c78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fec9d9f-d08a-4901-8830-0498e986d4f0', 'volume_name': 'volume-8fec9d9f-d08a-4901-8830-0498e986d4f0', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72fb93d2-2048-419a-98d3-1c15d92f8c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72fb93d2-2048-419a-98d3-1c15d92f8c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:23 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32aee295-e246-4b38-9d18-d0bcd6430647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:23 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Volume 8fec9d9f-d08a-4901-8830-0498e986d4f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fec9d9f-d08a-4901-8830-0498e986d4f0', 'volume_size': 1} Jul 21 02:18:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:18:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:18:23 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1907138081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fec9d9f-d08a-4901-8830-0498e986d4f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4e9443bc0b4fc4b1a0e0262c92d685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:18:24Z,use_quota=True,user_id='a010233373884346ad1545e1185f40a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:18:23 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Creating volume 8fec9d9f-d08a-4901-8830-0498e986d4f0 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:18:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:18:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:18:23 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:18:23 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:18:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:18:23 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:18:23 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:18:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8fec9d9f-d08a-4901-8830-0498e986d4f0 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:23 devstack sudo[101243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8fec9d9f-d08a-4901-8830-0498e986d4f0 1073741824 Jul 21 02:18:23 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:24 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8fec9d9f-d08a-4901-8830-0498e986d4f0 1073741824" returned: 0 in 0.434s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8fec9d9f-d08a-4901-8830-0498e986d4f0 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:24 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8fec9d9f-d08a-4901-8830-0498e986d4f0 Jul 21 02:18:24 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:24 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8fec9d9f-d08a-4901-8830-0498e986d4f0" returned: 0 in 0.248s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:24 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:18:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:18:24 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32aee295-e246-4b38-9d18-d0bcd6430647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fec9d9f-d08a-4901-8830-0498e986d4f0', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:24 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (322739c9-9699-4870-b45e-b30eebb83cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:24 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Volume volume-8fec9d9f-d08a-4901-8830-0498e986d4f0 (8fec9d9f-d08a-4901-8830-0498e986d4f0): created successfully Jul 21 02:18:24 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (322739c9-9699-4870-b45e-b30eebb83cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:24 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Flow 'volume_create_manager' (b3c7da42-ce9a-4550-9cd1-7809f177bc65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:18:24 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-7fab7fd6-2d0c-4e55-97b5-e8d0b590fa20 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Created volume successfully. Jul 21 02:18:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-283d8b62-1c80-483c-8782-50fb20ff5b4a req-fb98c8d0-7b7f-4973-802d-7ef219ac62cd tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:18:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-283d8b62-1c80-483c-8782-50fb20ff5b4a req-fb98c8d0-7b7f-4973-802d-7ef219ac62cd tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:18:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-283d8b62-1c80-483c-8782-50fb20ff5b4a req-fb98c8d0-7b7f-4973-802d-7ef219ac62cd tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:18:25 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-283d8b62-1c80-483c-8782-50fb20ff5b4a req-fb98c8d0-7b7f-4973-802d-7ef219ac62cd tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea', 'name': 'volume-8fec9d9f-d08a-4901-8830-0498e986d4f0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '13ae6c50-92d3-494d-865d-1d3bc74bfd97', 'enforce_multipath': True} {{(pid=87566) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 02:18:25 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-283d8b62-1c80-483c-8782-50fb20ff5b4a req-fb98c8d0-7b7f-4973-802d-7ef219ac62cd tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] attachment_update completed successfully. Jul 21 02:18:29 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-4d52244b-fe7f-4846-9346-be60f957dde4 req-1a5880df-fa7c-4c47-9d24-d5841566e50e tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Terminate volume connection completed successfully. Jul 21 02:18:29 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-4d52244b-fe7f-4846-9346-be60f957dde4 req-1a5880df-fa7c-4c47-9d24-d5841566e50e tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Deleting attachment 13ae6c50-92d3-494d-865d-1d3bc74bfd97. {{(pid=87566) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 02:18:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1a8d7df6-5934-48b8-8ac4-799f43eff0d2 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Acquiring lock "cinder-8fec9d9f-d08a-4901-8830-0498e986d4f0-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:18:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1a8d7df6-5934-48b8-8ac4-799f43eff0d2 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Lock "cinder-8fec9d9f-d08a-4901-8830-0498e986d4f0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:18:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1a8d7df6-5934-48b8-8ac4-799f43eff0d2 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Acquiring lock "cinder-quobyte-8fec9d9f-d08a-4901-8830-0498e986d4f0" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:18:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1a8d7df6-5934-48b8-8ac4-799f43eff0d2 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Lock "cinder-quobyte-8fec9d9f-d08a-4901-8830-0498e986d4f0" acquired by "delete_volume" :: waited 0.019s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:18:30 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[8943ac9f-4679-4a98-bd36-e6804d337d39]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:18:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1a8d7df6-5934-48b8-8ac4-799f43eff0d2 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8fec9d9f-d08a-4901-8830-0498e986d4f0 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:30 devstack sudo[101677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8fec9d9f-d08a-4901-8830-0498e986d4f0 Jul 21 02:18:30 devstack sudo[101677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:30 devstack sudo[101677]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1a8d7df6-5934-48b8-8ac4-799f43eff0d2 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8fec9d9f-d08a-4901-8830-0498e986d4f0" returned: 0 in 0.397s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1a8d7df6-5934-48b8-8ac4-799f43eff0d2 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8fec9d9f-d08a-4901-8830-0498e986d4f0 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:30 devstack sudo[101682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8fec9d9f-d08a-4901-8830-0498e986d4f0 Jul 21 02:18:30 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:30 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1a8d7df6-5934-48b8-8ac4-799f43eff0d2 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8fec9d9f-d08a-4901-8830-0498e986d4f0" returned: 0 in 0.296s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1a8d7df6-5934-48b8-8ac4-799f43eff0d2 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Lock "cinder-quobyte-8fec9d9f-d08a-4901-8830-0498e986d4f0" released by "delete_volume" :: held 0.761s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:18:31 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-1a8d7df6-5934-48b8-8ac4-799f43eff0d2 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Created reservations ['9d7c49f3-15e2-41a7-9654-82860263eb2a', '7121bd58-ed32-483b-874f-932e7f125305', '95789379-9eeb-433c-82d0-8f77a5e598db', '32cff3c2-1a5b-44d3-b7d5-0524af3bc8d6'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:18:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-1a8d7df6-5934-48b8-8ac4-799f43eff0d2 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:18:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-1a8d7df6-5934-48b8-8ac4-799f43eff0d2 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:18:31 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-1a8d7df6-5934-48b8-8ac4-799f43eff0d2 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:18:31 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-1a8d7df6-5934-48b8-8ac4-799f43eff0d2 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:18:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-1a8d7df6-5934-48b8-8ac4-799f43eff0d2 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:18:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1a8d7df6-5934-48b8-8ac4-799f43eff0d2 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-d9742d52-78bd-4b2a-994d-68061ccbef20 req-96dd7bea-1c17-42da-ad34-af306dab9a32 tempest-TestServerVolumeAttachmentScenario-159704105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:18:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-d9742d52-78bd-4b2a-994d-68061ccbef20 req-96dd7bea-1c17-42da-ad34-af306dab9a32 tempest-TestServerVolumeAttachmentScenario-159704105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:18:31 devstack sudo[101694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:18:31 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-d9742d52-78bd-4b2a-994d-68061ccbef20 req-96dd7bea-1c17-42da-ad34-af306dab9a32 tempest-TestServerVolumeAttachmentScenario-159704105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:18:31 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-d9742d52-78bd-4b2a-994d-68061ccbef20 req-96dd7bea-1c17-42da-ad34-af306dab9a32 tempest-TestServerVolumeAttachmentScenario-159704105 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea', 'name': 'volume-c92112c5-c00c-4d35-aa48-cc26137d87f5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1c1a29ba-29ce-4cc7-a8bd-6e48fb1f0345', 'enforce_multipath': True} {{(pid=87566) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 02:18:31 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-d9742d52-78bd-4b2a-994d-68061ccbef20 req-96dd7bea-1c17-42da-ad34-af306dab9a32 tempest-TestServerVolumeAttachmentScenario-159704105 None] attachment_update completed successfully. Jul 21 02:18:31 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1a8d7df6-5934-48b8-8ac4-799f43eff0d2 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.330s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:31 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-1a8d7df6-5934-48b8-8ac4-799f43eff0d2 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:18:31 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-1a8d7df6-5934-48b8-8ac4-799f43eff0d2 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Deleted volume successfully. Jul 21 02:18:31 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1a8d7df6-5934-48b8-8ac4-799f43eff0d2 tempest-TestServerVolumeAttachScenarioOldVersion-1101573610 None] Lock "cinder-8fec9d9f-d08a-4901-8830-0498e986d4f0-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:18:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-8fee93a2-e646-4cbf-8e45-29f14d8463de req-d2a7e9e3-d8f7-4a9c-8415-3a8a8eefc920 tempest-TestServerVolumeAttachmentScenario-159704105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:18:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-8fee93a2-e646-4cbf-8e45-29f14d8463de req-d2a7e9e3-d8f7-4a9c-8415-3a8a8eefc920 tempest-TestServerVolumeAttachmentScenario-159704105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:18:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-8fee93a2-e646-4cbf-8e45-29f14d8463de req-d2a7e9e3-d8f7-4a9c-8415-3a8a8eefc920 tempest-TestServerVolumeAttachmentScenario-159704105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:18:36 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-8fee93a2-e646-4cbf-8e45-29f14d8463de req-d2a7e9e3-d8f7-4a9c-8415-3a8a8eefc920 tempest-TestServerVolumeAttachmentScenario-159704105 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea', 'name': 'volume-5e274fb9-a1c7-410c-abe3-37c8b3e0e716', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4c7b509f-b49e-4dd7-9fc6-dfd8aadfb77d', 'enforce_multipath': True} {{(pid=87566) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 02:18:36 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-8fee93a2-e646-4cbf-8e45-29f14d8463de req-d2a7e9e3-d8f7-4a9c-8415-3a8a8eefc920 tempest-TestServerVolumeAttachmentScenario-159704105 None] attachment_update completed successfully. Jul 21 02:18:39 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-8c9ae101-0c60-435a-9243-312b62f7f415 req-73fcc7d4-d8ed-45fd-9f8c-ca18774217c0 tempest-TestServerVolumeAttachmentScenario-159704105 None] Terminate volume connection completed successfully. Jul 21 02:18:39 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-8c9ae101-0c60-435a-9243-312b62f7f415 req-73fcc7d4-d8ed-45fd-9f8c-ca18774217c0 tempest-TestServerVolumeAttachmentScenario-159704105 None] Deleting attachment 4c7b509f-b49e-4dd7-9fc6-dfd8aadfb77d. {{(pid=87566) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 02:18:41 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-8417c1cd-b72f-4fd8-b5a2-edce1e12a1e0 req-7b88ed25-c979-4be7-95df-92dc913723b9 tempest-TestServerVolumeAttachmentScenario-159704105 None] Terminate volume connection completed successfully. Jul 21 02:18:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-8417c1cd-b72f-4fd8-b5a2-edce1e12a1e0 req-7b88ed25-c979-4be7-95df-92dc913723b9 tempest-TestServerVolumeAttachmentScenario-159704105 None] Deleting attachment 1c1a29ba-29ce-4cc7-a8bd-6e48fb1f0345. {{(pid=87566) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 02:18:44 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:18:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] Flow 'volume_create_manager' (5b665820-dbbb-4581-83ba-4beeb7bc6883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:18:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd0a54a4-5c67-4a2e-aee4-4e3a9d647fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd0a54a4-5c67-4a2e-aee4-4e3a9d647fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-651906569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b10d0d16-be6c-4518-9b86-2e34daea0115,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0776b570ea7e4b05a5a52c47a6f697e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:18:45Z,use_quota=True,user_id='f71db74fdaa64f8bb1ebe81ed6b00d34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2591c053-8efa-4883-a8f5-02af86887249),volume_type_id=2591c053-8efa-4883-a8f5-02af86887249)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34dd2d87-0c91-40b4-8cc7-53da7d06ab70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34dd2d87-0c91-40b4-8cc7-53da7d06ab70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23abf36c-07ab-4186-ad00-1c907f447d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23abf36c-07ab-4186-ad00-1c907f447d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b10d0d16-be6c-4518-9b86-2e34daea0115', 'volume_name': 'volume-b10d0d16-be6c-4518-9b86-2e34daea0115', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcfe6a86-3ba3-4054-8fe4-cc416592077e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcfe6a86-3ba3-4054-8fe4-cc416592077e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (186627fa-8ef6-41de-8dca-29d6b556f4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:44 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] Volume b10d0d16-be6c-4518-9b86-2e34daea0115: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b10d0d16-be6c-4518-9b86-2e34daea0115', 'volume_size': 1} Jul 21 02:18:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:18:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:18:44 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-651906569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b10d0d16-be6c-4518-9b86-2e34daea0115,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0776b570ea7e4b05a5a52c47a6f697e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:18:45Z,use_quota=True,user_id='f71db74fdaa64f8bb1ebe81ed6b00d34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2591c053-8efa-4883-a8f5-02af86887249),volume_type_id=2591c053-8efa-4883-a8f5-02af86887249)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:18:44 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] Creating volume b10d0d16-be6c-4518-9b86-2e34daea0115 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:18:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:18:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:18:44 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:18:44 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:18:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:18:44 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:18:44 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:18:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b10d0d16-be6c-4518-9b86-2e34daea0115 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:44 devstack sudo[102175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b10d0d16-be6c-4518-9b86-2e34daea0115 1073741824 Jul 21 02:18:44 devstack sudo[102175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:45 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:18:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] Flow 'volume_create_manager' (7bc4fb7f-c08c-4cd4-a9c8-8b5653873f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:18:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43545c99-3499-4d4a-82da-87d1c28084a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43545c99-3499-4d4a-82da-87d1c28084a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1267158168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2726e0e-ee3e-4736-b07d-eb98066a5c04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0776b570ea7e4b05a5a52c47a6f697e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:18:45Z,use_quota=True,user_id='f71db74fdaa64f8bb1ebe81ed6b00d34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d600d008-1f81-46d4-ba4f-54adae1eb531),volume_type_id=d600d008-1f81-46d4-ba4f-54adae1eb531)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dec9c06-2138-4008-b08e-6eeb2aef606d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dec9c06-2138-4008-b08e-6eeb2aef606d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c920a6dc-962a-4da9-9008-3b8d834c4c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c920a6dc-962a-4da9-9008-3b8d834c4c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2726e0e-ee3e-4736-b07d-eb98066a5c04', 'volume_name': 'volume-b2726e0e-ee3e-4736-b07d-eb98066a5c04', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16378f05-f98f-4ff1-a8af-8047da8ae670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16378f05-f98f-4ff1-a8af-8047da8ae670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2179890c-6108-4018-8b0c-8466576d5963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:45 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] Volume b2726e0e-ee3e-4736-b07d-eb98066a5c04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2726e0e-ee3e-4736-b07d-eb98066a5c04', 'volume_size': 1} Jul 21 02:18:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:18:45 devstack sudo[102175]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b10d0d16-be6c-4518-9b86-2e34daea0115 1073741824" returned: 0 in 0.778s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b10d0d16-be6c-4518-9b86-2e34daea0115 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:45 devstack sudo[102181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b10d0d16-be6c-4518-9b86-2e34daea0115 Jul 21 02:18:45 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:45 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b10d0d16-be6c-4518-9b86-2e34daea0115" returned: 0 in 0.398s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:45 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:18:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:18:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.623s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:18:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1267158168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2726e0e-ee3e-4736-b07d-eb98066a5c04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0776b570ea7e4b05a5a52c47a6f697e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:18:45Z,use_quota=True,user_id='f71db74fdaa64f8bb1ebe81ed6b00d34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d600d008-1f81-46d4-ba4f-54adae1eb531),volume_type_id=d600d008-1f81-46d4-ba4f-54adae1eb531)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:18:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] Creating volume b2726e0e-ee3e-4736-b07d-eb98066a5c04 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:18:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:18:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:18:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:18:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:18:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:18:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:18:46 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:18:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b2726e0e-ee3e-4736-b07d-eb98066a5c04 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (186627fa-8ef6-41de-8dca-29d6b556f4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b10d0d16-be6c-4518-9b86-2e34daea0115', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ad9a48-3b4f-42ca-9921-a875f624320e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:46 devstack sudo[102184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b2726e0e-ee3e-4736-b07d-eb98066a5c04 1073741824 Jul 21 02:18:46 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:46 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] Volume volume-b10d0d16-be6c-4518-9b86-2e34daea0115 (b10d0d16-be6c-4518-9b86-2e34daea0115): created successfully Jul 21 02:18:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ad9a48-3b4f-42ca-9921-a875f624320e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] Flow 'volume_create_manager' (5b665820-dbbb-4581-83ba-4beeb7bc6883) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:18:46 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-4e4319e9-ea2d-49f6-9983-90ffbc6d9adc tempest-TestInstancesWithCinderVolumes-1617127660 None] Created volume successfully. Jul 21 02:18:46 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:18:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Flow 'volume_create_manager' (4b06beb0-e784-49f6-a7d5-f6c8136ccff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:18:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c43ca22-9070-413a-baff-0e2f2d756f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c43ca22-9070-413a-baff-0e2f2d756f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1074333891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8511555e-c92b-4a45-a9cf-110dd33a60c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0776b570ea7e4b05a5a52c47a6f697e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:18:46Z,use_quota=True,user_id='f71db74fdaa64f8bb1ebe81ed6b00d34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d625caf7-853a-44dd-b84f-07a8af03399d),volume_type_id=d625caf7-853a-44dd-b84f-07a8af03399d)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6e31ef8-088f-4c6e-b5ef-7d744c55a990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6e31ef8-088f-4c6e-b5ef-7d744c55a990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (280111ac-3339-4d65-90ae-5d54b2c5109b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:46 devstack cinder-volume[87566]: DEBUG cinder.image.glance [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Creating Keystone auth plugin from conf {{(pid=87566) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 02:18:46 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (280111ac-3339-4d65-90ae-5d54b2c5109b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8511555e-c92b-4a45-a9cf-110dd33a60c0', 'volume_name': 'volume-8511555e-c92b-4a45-a9cf-110dd33a60c0', 'volume_size': 1, 'image_id': 'bfe0d211-974a-4c91-87d3-881f9d2f2717', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfe0d211-974a-4c91-87d3-881f9d2f2717', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--601761177', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0776b570ea7e4b05a5a52c47a6f697e2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bfe0d211-974a-4c91-87d3-881f9d2f2717', 'created_at': datetime.datetime(2026, 7, 21, 0, 18, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 0, 18, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfe0d211-974a-4c91-87d3-881f9d2f2717/file', 'properties': {}}, 'image_service': }' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4766ebc-b5f3-4f06-902a-ca190a7d7ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4766ebc-b5f3-4f06-902a-ca190a7d7ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e3cf221-5651-4d35-a3b9-7d652245b784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:46 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Volume 8511555e-c92b-4a45-a9cf-110dd33a60c0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8511555e-c92b-4a45-a9cf-110dd33a60c0', 'volume_size': 1, 'image_id': 'bfe0d211-974a-4c91-87d3-881f9d2f2717', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfe0d211-974a-4c91-87d3-881f9d2f2717', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--601761177', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0776b570ea7e4b05a5a52c47a6f697e2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bfe0d211-974a-4c91-87d3-881f9d2f2717', 'created_at': datetime.datetime(2026, 7, 21, 0, 18, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 0, 18, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfe0d211-974a-4c91-87d3-881f9d2f2717/file', 'properties': {}}, 'image_service': } Jul 21 02:18:46 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Trying to clone 8511555e-c92b-4a45-a9cf-110dd33a60c0 from image bfe0d211-974a-4c91-87d3-881f9d2f2717 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bfe0d211-974a-4c91-87d3-881f9d2f2717', 'metadata': {}}]). {{(pid=87566) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 02:18:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b2726e0e-ee3e-4736-b07d-eb98066a5c04 1073741824" returned: 0 in 0.652s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b2726e0e-ee3e-4736-b07d-eb98066a5c04 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:46 devstack sudo[102190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b2726e0e-ee3e-4736-b07d-eb98066a5c04 Jul 21 02:18:46 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:46 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f61e6c61-9732-4077-bee5-773a2db71677 tempest-TestServerVolumeAttachmentScenario-159704105 None] Acquiring lock "cinder-5e274fb9-a1c7-410c-abe3-37c8b3e0e716-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:18:46 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f61e6c61-9732-4077-bee5-773a2db71677 tempest-TestServerVolumeAttachmentScenario-159704105 None] Lock "cinder-5e274fb9-a1c7-410c-abe3-37c8b3e0e716-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:18:46 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f61e6c61-9732-4077-bee5-773a2db71677 tempest-TestServerVolumeAttachmentScenario-159704105 None] Acquiring lock "cinder-quobyte-5e274fb9-a1c7-410c-abe3-37c8b3e0e716" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:18:46 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f61e6c61-9732-4077-bee5-773a2db71677 tempest-TestServerVolumeAttachmentScenario-159704105 None] Lock "cinder-quobyte-5e274fb9-a1c7-410c-abe3-37c8b3e0e716" acquired by "delete_volume" :: waited 0.019s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:18:47 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[e416e690-065e-4895-8b4c-cb564566cf20]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:18:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f61e6c61-9732-4077-bee5-773a2db71677 tempest-TestServerVolumeAttachmentScenario-159704105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5e274fb9-a1c7-410c-abe3-37c8b3e0e716 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:47 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b2726e0e-ee3e-4736-b07d-eb98066a5c04" returned: 0 in 0.344s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:47 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:18:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:18:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2179890c-6108-4018-8b0c-8466576d5963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2726e0e-ee3e-4736-b07d-eb98066a5c04', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4949ba0-7dfc-4dcf-95e1-e4fc9043ad72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:47 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] Volume volume-b2726e0e-ee3e-4736-b07d-eb98066a5c04 (b2726e0e-ee3e-4736-b07d-eb98066a5c04): created successfully Jul 21 02:18:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4949ba0-7dfc-4dcf-95e1-e4fc9043ad72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] Flow 'volume_create_manager' (7bc4fb7f-c08c-4cd4-a9c8-8b5653873f5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:18:47 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-62c7a597-ba7b-40a8-b917-14b37086445d tempest-TestInstancesWithCinderVolumes-1617127660 None] Created volume successfully. Jul 21 02:18:47 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5e274fb9-a1c7-410c-abe3-37c8b3e0e716 Jul 21 02:18:47 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:47 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f61e6c61-9732-4077-bee5-773a2db71677 tempest-TestServerVolumeAttachmentScenario-159704105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5e274fb9-a1c7-410c-abe3-37c8b3e0e716" returned: 0 in 0.455s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f61e6c61-9732-4077-bee5-773a2db71677 tempest-TestServerVolumeAttachmentScenario-159704105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5e274fb9-a1c7-410c-abe3-37c8b3e0e716 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:47 devstack sudo[102199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5e274fb9-a1c7-410c-abe3-37c8b3e0e716 Jul 21 02:18:47 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:47 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f61e6c61-9732-4077-bee5-773a2db71677 tempest-TestServerVolumeAttachmentScenario-159704105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5e274fb9-a1c7-410c-abe3-37c8b3e0e716" returned: 0 in 0.264s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f61e6c61-9732-4077-bee5-773a2db71677 tempest-TestServerVolumeAttachmentScenario-159704105 None] Lock "cinder-quobyte-5e274fb9-a1c7-410c-abe3-37c8b3e0e716" released by "delete_volume" :: held 0.779s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:18:47 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-f61e6c61-9732-4077-bee5-773a2db71677 tempest-TestServerVolumeAttachmentScenario-159704105 None] Created reservations ['397272c5-bda6-4d7b-89a0-e90c878cdb5d', '924a5330-01ff-49dd-93e9-3e8225247472', 'bc7313cc-8069-4ce6-bef8-4d6dfc30da1d', '9114ac1b-8db9-4dc0-8c87-3bf14da103e8'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:18:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f61e6c61-9732-4077-bee5-773a2db71677 tempest-TestServerVolumeAttachmentScenario-159704105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:18:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f61e6c61-9732-4077-bee5-773a2db71677 tempest-TestServerVolumeAttachmentScenario-159704105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:18:47 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f61e6c61-9732-4077-bee5-773a2db71677 tempest-TestServerVolumeAttachmentScenario-159704105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:18:47 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f61e6c61-9732-4077-bee5-773a2db71677 tempest-TestServerVolumeAttachmentScenario-159704105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:18:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f61e6c61-9732-4077-bee5-773a2db71677 tempest-TestServerVolumeAttachmentScenario-159704105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:18:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f61e6c61-9732-4077-bee5-773a2db71677 tempest-TestServerVolumeAttachmentScenario-159704105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:47 devstack sudo[102203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:18:47 devstack sudo[102203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:48 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-afe054c8-2370-4623-a0a9-32aa92511709 tempest-TestServerVolumeAttachmentScenario-159704105 None] Acquiring lock "cinder-c92112c5-c00c-4d35-aa48-cc26137d87f5-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:18:48 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-afe054c8-2370-4623-a0a9-32aa92511709 tempest-TestServerVolumeAttachmentScenario-159704105 None] Lock "cinder-c92112c5-c00c-4d35-aa48-cc26137d87f5-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:18:48 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-afe054c8-2370-4623-a0a9-32aa92511709 tempest-TestServerVolumeAttachmentScenario-159704105 None] Acquiring lock "cinder-quobyte-c92112c5-c00c-4d35-aa48-cc26137d87f5" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:18:48 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-afe054c8-2370-4623-a0a9-32aa92511709 tempest-TestServerVolumeAttachmentScenario-159704105 None] Lock "cinder-quobyte-c92112c5-c00c-4d35-aa48-cc26137d87f5" acquired by "delete_volume" :: waited 0.018s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:18:48 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a19cc9-8c93-4579-8bd9-72e7063a71c8]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:18:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-afe054c8-2370-4623-a0a9-32aa92511709 tempest-TestServerVolumeAttachmentScenario-159704105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c92112c5-c00c-4d35-aa48-cc26137d87f5 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:48 devstack sudo[102203]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f61e6c61-9732-4077-bee5-773a2db71677 tempest-TestServerVolumeAttachmentScenario-159704105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.350s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:48 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-f61e6c61-9732-4077-bee5-773a2db71677 tempest-TestServerVolumeAttachmentScenario-159704105 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:18:48 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-f61e6c61-9732-4077-bee5-773a2db71677 tempest-TestServerVolumeAttachmentScenario-159704105 None] Deleted volume successfully. Jul 21 02:18:48 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f61e6c61-9732-4077-bee5-773a2db71677 tempest-TestServerVolumeAttachmentScenario-159704105 None] Lock "cinder-5e274fb9-a1c7-410c-abe3-37c8b3e0e716-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:18:48 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c92112c5-c00c-4d35-aa48-cc26137d87f5 Jul 21 02:18:48 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:48 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-afe054c8-2370-4623-a0a9-32aa92511709 tempest-TestServerVolumeAttachmentScenario-159704105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c92112c5-c00c-4d35-aa48-cc26137d87f5" returned: 0 in 0.462s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-afe054c8-2370-4623-a0a9-32aa92511709 tempest-TestServerVolumeAttachmentScenario-159704105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c92112c5-c00c-4d35-aa48-cc26137d87f5 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:48 devstack sudo[102211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c92112c5-c00c-4d35-aa48-cc26137d87f5 Jul 21 02:18:48 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:48 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:18:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:18:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:18:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:18:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:18:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:18:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:48 devstack sudo[102214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:18:48 devstack sudo[102214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:48 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-afe054c8-2370-4623-a0a9-32aa92511709 tempest-TestServerVolumeAttachmentScenario-159704105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c92112c5-c00c-4d35-aa48-cc26137d87f5" returned: 0 in 0.257s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:48 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-afe054c8-2370-4623-a0a9-32aa92511709 tempest-TestServerVolumeAttachmentScenario-159704105 None] Lock "cinder-quobyte-c92112c5-c00c-4d35-aa48-cc26137d87f5" released by "delete_volume" :: held 0.763s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:18:49 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-afe054c8-2370-4623-a0a9-32aa92511709 tempest-TestServerVolumeAttachmentScenario-159704105 None] Created reservations ['364cbf64-ee99-45db-83a8-c508dda13303', '2bcda5f9-152e-45c3-b070-08645b5a52b1', '75b95e65-39be-4d25-9741-6d1681a90841', 'c3f73e72-85d9-425a-b2ac-3479b09de91c'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:18:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-afe054c8-2370-4623-a0a9-32aa92511709 tempest-TestServerVolumeAttachmentScenario-159704105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:18:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-afe054c8-2370-4623-a0a9-32aa92511709 tempest-TestServerVolumeAttachmentScenario-159704105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:18:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-afe054c8-2370-4623-a0a9-32aa92511709 tempest-TestServerVolumeAttachmentScenario-159704105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:18:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-afe054c8-2370-4623-a0a9-32aa92511709 tempest-TestServerVolumeAttachmentScenario-159704105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:18:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-afe054c8-2370-4623-a0a9-32aa92511709 tempest-TestServerVolumeAttachmentScenario-159704105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:18:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-afe054c8-2370-4623-a0a9-32aa92511709 tempest-TestServerVolumeAttachmentScenario-159704105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:49 devstack sudo[102217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:18:49 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:49 devstack sudo[102214]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.306s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:49 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:18:49 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager._thread_info {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:18:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread count: 28 {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 02:18:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread info: [<_MainThread(MainThread, started 135786703114368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 02:18:49 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-afe054c8-2370-4623-a0a9-32aa92511709 tempest-TestServerVolumeAttachmentScenario-159704105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.345s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:49 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-afe054c8-2370-4623-a0a9-32aa92511709 tempest-TestServerVolumeAttachmentScenario-159704105 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:18:49 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-afe054c8-2370-4623-a0a9-32aa92511709 tempest-TestServerVolumeAttachmentScenario-159704105 None] Deleted volume successfully. Jul 21 02:18:49 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-afe054c8-2370-4623-a0a9-32aa92511709 tempest-TestServerVolumeAttachmentScenario-159704105 None] Lock "cinder-c92112c5-c00c-4d35-aa48-cc26137d87f5-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:18:51 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bfe0d211-974a-4c91-87d3-881f9d2f2717_z49c5rj9devstack@QuobyteHD, size 20.69 MB, duration 4.60 sec {{(pid=87566) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 02:18:51 devstack cinder-volume[87566]: INFO cinder.image.image_utils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Image download 20.69 MB at 4.50 MB/s Jul 21 02:18:51 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[088482fe-ec50-4866-8bd5-00ffebf9981b]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:18:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfe0d211-974a-4c91-87d3-881f9d2f2717_z49c5rj9devstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:51 devstack sudo[102224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfe0d211-974a-4c91-87d3-881f9d2f2717_z49c5rj9devstack@QuobyteHD Jul 21 02:18:51 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:51 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfe0d211-974a-4c91-87d3-881f9d2f2717_z49c5rj9devstack@QuobyteHD" returned: 0 in 0.372s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:51 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Temporary image bfe0d211-974a-4c91-87d3-881f9d2f2717 is fetched for user f71db74fdaa64f8bb1ebe81ed6b00d34. {{(pid=87566) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 02:18:51 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[1618554c-57a9-48c1-a906-edabca6a265a]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:18:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfe0d211-974a-4c91-87d3-881f9d2f2717_z49c5rj9devstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:51 devstack sudo[102229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfe0d211-974a-4c91-87d3-881f9d2f2717_z49c5rj9devstack@QuobyteHD Jul 21 02:18:51 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:52 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfe0d211-974a-4c91-87d3-881f9d2f2717_z49c5rj9devstack@QuobyteHD" returned: 0 in 0.391s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:18:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:18:52 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1074333891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8511555e-c92b-4a45-a9cf-110dd33a60c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0776b570ea7e4b05a5a52c47a6f697e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:18:46Z,use_quota=True,user_id='f71db74fdaa64f8bb1ebe81ed6b00d34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d625caf7-853a-44dd-b84f-07a8af03399d),volume_type_id=d625caf7-853a-44dd-b84f-07a8af03399d)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:18:52 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Creating volume 8511555e-c92b-4a45-a9cf-110dd33a60c0 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:18:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:18:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:18:52 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:18:52 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:18:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:18:52 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:18:52 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:18:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8511555e-c92b-4a45-a9cf-110dd33a60c0 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:52 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8511555e-c92b-4a45-a9cf-110dd33a60c0 1073741824 Jul 21 02:18:52 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:52 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8511555e-c92b-4a45-a9cf-110dd33a60c0 1073741824" returned: 0 in 0.601s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8511555e-c92b-4a45-a9cf-110dd33a60c0 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:52 devstack sudo[102241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8511555e-c92b-4a45-a9cf-110dd33a60c0 Jul 21 02:18:52 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:53 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8511555e-c92b-4a45-a9cf-110dd33a60c0" returned: 0 in 0.276s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:18:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:18:53 devstack cinder-volume[87566]: DEBUG cinder.volume.volume_utils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Attempting download of bfe0d211-974a-4c91-87d3-881f9d2f2717 ((None, [{'url': 'file:///opt/stack/data/glance/images/bfe0d211-974a-4c91-87d3-881f9d2f2717', 'metadata': {}}])) to volume 8511555e-c92b-4a45-a9cf-110dd33a60c0. {{(pid=87566) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 02:18:53 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a34653e-6299-4d98-ac02-269cd2710f27]: (4, 'raw') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:18:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfe0d211-974a-4c91-87d3-881f9d2f2717_3dib4d74 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:53 devstack sudo[102245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfe0d211-974a-4c91-87d3-881f9d2f2717_3dib4d74 Jul 21 02:18:53 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:53 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:18:53 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] Flow 'volume_create_manager' (76524357-c31f-463e-8ffb-5d28628f72f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:18:53 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82e74dc8-8443-441d-9e80-631b7de8e0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:53 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82e74dc8-8443-441d-9e80-631b7de8e0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-899541048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f049228d-9e4c-47e8-85af-e15636be4701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88bb92473b7746f8aae03068ce42a166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:18:53Z,use_quota=True,user_id='fa8cfca8732541d49110fa3523a265cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:53 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c594db-ff69-47d7-8ab1-15b51de51e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:53 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c594db-ff69-47d7-8ab1-15b51de51e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:53 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1da2a5b-4a3f-4e2b-b2ab-b5a6bf27be91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:53 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1da2a5b-4a3f-4e2b-b2ab-b5a6bf27be91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f049228d-9e4c-47e8-85af-e15636be4701', 'volume_name': 'volume-f049228d-9e4c-47e8-85af-e15636be4701', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:53 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb24e5c5-66af-4bde-8d2a-44e0af5c747e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:53 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb24e5c5-66af-4bde-8d2a-44e0af5c747e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:53 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:53 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1d447e5-a4f9-4b14-8c7a-deb5be5e2ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:53 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] Volume f049228d-9e4c-47e8-85af-e15636be4701: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f049228d-9e4c-47e8-85af-e15636be4701', 'volume_size': 1} Jul 21 02:18:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:18:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:18:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-899541048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f049228d-9e4c-47e8-85af-e15636be4701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88bb92473b7746f8aae03068ce42a166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:18:53Z,use_quota=True,user_id='fa8cfca8732541d49110fa3523a265cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:18:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] Creating volume f049228d-9e4c-47e8-85af-e15636be4701 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:18:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:18:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:18:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:18:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:18:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:18:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:18:53 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:18:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f049228d-9e4c-47e8-85af-e15636be4701 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfe0d211-974a-4c91-87d3-881f9d2f2717_3dib4d74" returned: 0 in 0.478s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfe0d211-974a-4c91-87d3-881f9d2f2717_3dib4d74 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:53 devstack sudo[102249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f049228d-9e4c-47e8-85af-e15636be4701 1073741824 Jul 21 02:18:53 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:53 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfe0d211-974a-4c91-87d3-881f9d2f2717_3dib4d74 Jul 21 02:18:53 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:54 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:18:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] Flow 'volume_create_manager' (c468689b-767d-496a-bd0f-d4fa8f13a78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:18:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bf13f7c-a5cc-4c42-a938-cff6c9e71073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bf13f7c-a5cc-4c42-a938-cff6c9e71073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-999741769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4711c44-6a51-4814-b9a3-63be6bb40d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88bb92473b7746f8aae03068ce42a166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:18:54Z,use_quota=True,user_id='fa8cfca8732541d49110fa3523a265cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aad7d9d-8817-4103-9e5f-08a00001d50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aad7d9d-8817-4103-9e5f-08a00001d50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b47d472-62b2-41c4-8eb2-3f194b59f9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b47d472-62b2-41c4-8eb2-3f194b59f9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4711c44-6a51-4814-b9a3-63be6bb40d17', 'volume_name': 'volume-f4711c44-6a51-4814-b9a3-63be6bb40d17', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecf66f46-2b49-48d6-ae0b-dd81268863b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecf66f46-2b49-48d6-ae0b-dd81268863b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e16dd60-f985-469b-a59c-8f6ecdd9b3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:54 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] Volume f4711c44-6a51-4814-b9a3-63be6bb40d17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4711c44-6a51-4814-b9a3-63be6bb40d17', 'volume_size': 1} Jul 21 02:18:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:18:54 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfe0d211-974a-4c91-87d3-881f9d2f2717_3dib4d74" returned: 1 in 0.508s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfe0d211-974a-4c91-87d3-881f9d2f2717_3dib4d74' failed. Not Retrying. {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 02:18:54 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecff50a9-2707-4874-8e34-74ec1f6a3e93]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:18:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfe0d211-974a-4c91-87d3-881f9d2f2717_z49c5rj9devstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:54 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f049228d-9e4c-47e8-85af-e15636be4701 1073741824" returned: 0 in 0.724s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:54 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfe0d211-974a-4c91-87d3-881f9d2f2717_z49c5rj9devstack@QuobyteHD Jul 21 02:18:54 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f049228d-9e4c-47e8-85af-e15636be4701 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:54 devstack sudo[102296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f049228d-9e4c-47e8-85af-e15636be4701 Jul 21 02:18:54 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:54 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:18:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] Flow 'volume_create_manager' (01def9e2-2d40-4d65-bec9-68f796407ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:18:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1074c24-1ab0-47b5-b709-7cbc23b7c422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1074c24-1ab0-47b5-b709-7cbc23b7c422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-404818216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06115e41-29be-47f2-96c0-7ea6c9e4764e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88bb92473b7746f8aae03068ce42a166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:18:55Z,use_quota=True,user_id='fa8cfca8732541d49110fa3523a265cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d29b41d1-5224-4796-9186-b430b690db61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d29b41d1-5224-4796-9186-b430b690db61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad93ec14-b746-4b74-a168-56720d833b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad93ec14-b746-4b74-a168-56720d833b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06115e41-29be-47f2-96c0-7ea6c9e4764e', 'volume_name': 'volume-06115e41-29be-47f2-96c0-7ea6c9e4764e', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a5bb74-704a-425b-abc1-210fddffba29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a5bb74-704a-425b-abc1-210fddffba29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (192c7b17-d59d-4178-994e-b2f8e16765ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:54 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] Volume 06115e41-29be-47f2-96c0-7ea6c9e4764e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06115e41-29be-47f2-96c0-7ea6c9e4764e', 'volume_size': 1} Jul 21 02:18:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:18:54 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfe0d211-974a-4c91-87d3-881f9d2f2717_z49c5rj9devstack@QuobyteHD" returned: 0 in 0.655s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:54 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] bfe0d211-974a-4c91-87d3-881f9d2f2717 was qcow2, converting to qcow2 {{(pid=87566) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 02:18:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bfe0d211-974a-4c91-87d3-881f9d2f2717_z49c5rj9devstack@QuobyteHD /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8511555e-c92b-4a45-a9cf-110dd33a60c0 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:54 devstack sudo[102303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bfe0d211-974a-4c91-87d3-881f9d2f2717_z49c5rj9devstack@QuobyteHD /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8511555e-c92b-4a45-a9cf-110dd33a60c0 Jul 21 02:18:54 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:55 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f049228d-9e4c-47e8-85af-e15636be4701" returned: 0 in 0.574s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.931s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-999741769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4711c44-6a51-4814-b9a3-63be6bb40d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88bb92473b7746f8aae03068ce42a166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:18:54Z,use_quota=True,user_id='fa8cfca8732541d49110fa3523a265cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] Creating volume f4711c44-6a51-4814-b9a3-63be6bb40d17 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:18:55 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f4711c44-6a51-4814-b9a3-63be6bb40d17 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1d447e5-a4f9-4b14-8c7a-deb5be5e2ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f049228d-9e4c-47e8-85af-e15636be4701', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:55 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f4711c44-6a51-4814-b9a3-63be6bb40d17 1073741824 Jul 21 02:18:55 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (889a9c32-cdae-492f-b559-75f500c38943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:55 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] Volume volume-f049228d-9e4c-47e8-85af-e15636be4701 (f049228d-9e4c-47e8-85af-e15636be4701): created successfully Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (889a9c32-cdae-492f-b559-75f500c38943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] Flow 'volume_create_manager' (76524357-c31f-463e-8ffb-5d28628f72f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] Flow 'volume_create_manager' (3bd6f7a1-d41f-4ff6-b60d-370ecd5ba277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c25d3807-57bd-43cb-859b-1bd07723fefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c25d3807-57bd-43cb-859b-1bd07723fefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-171190197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c40b96e-7fdd-44db-b129-4083ff2e8320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88bb92473b7746f8aae03068ce42a166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:18:55Z,use_quota=True,user_id='fa8cfca8732541d49110fa3523a265cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (209be20d-77ac-4f4a-9795-142ffbb49e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (209be20d-77ac-4f4a-9795-142ffbb49e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b194753-5690-4158-8e19-fa6c0e06caf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b194753-5690-4158-8e19-fa6c0e06caf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c40b96e-7fdd-44db-b129-4083ff2e8320', 'volume_name': 'volume-7c40b96e-7fdd-44db-b129-4083ff2e8320', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1028a8a9-2af1-4f3f-bedf-86cc63e44798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1028a8a9-2af1-4f3f-bedf-86cc63e44798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bad386d-4e84-4454-b4bf-071350701b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:55 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] Volume 7c40b96e-7fdd-44db-b129-4083ff2e8320: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c40b96e-7fdd-44db-b129-4083ff2e8320', 'volume_size': 1} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:18:55 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-117fc6f5-8bb4-492e-bab3-947dfef17da6 tempest-CreateVolumesFromImageTest-1402009570 None] Created volume successfully. Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] Flow 'volume_create_manager' (68bc552f-e55f-460a-9747-c8ff7f0450e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed213c2-6119-4816-93e1-42bb0a10a893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed213c2-6119-4816-93e1-42bb0a10a893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-882533132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a8e92d3-0a94-4457-9726-6e880e003857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88bb92473b7746f8aae03068ce42a166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:18:56Z,use_quota=True,user_id='fa8cfca8732541d49110fa3523a265cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87b82e92-76f1-4df3-9f42-64626685dc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87b82e92-76f1-4df3-9f42-64626685dc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9110081-2d1e-4dad-a6f8-cd42671d0aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9110081-2d1e-4dad-a6f8-cd42671d0aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a8e92d3-0a94-4457-9726-6e880e003857', 'volume_name': 'volume-4a8e92d3-0a94-4457-9726-6e880e003857', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (468f8b85-59c1-4fa2-98a8-a535dc5f8023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (468f8b85-59c1-4fa2-98a8-a535dc5f8023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5010e8da-5acf-41d4-9d89-39fa6e64c076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:55 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] Volume 4a8e92d3-0a94-4457-9726-6e880e003857: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a8e92d3-0a94-4457-9726-6e880e003857', 'volume_size': 1} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:18:55 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f4711c44-6a51-4814-b9a3-63be6bb40d17 1073741824" returned: 0 in 0.709s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f4711c44-6a51-4814-b9a3-63be6bb40d17 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:55 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f4711c44-6a51-4814-b9a3-63be6bb40d17 Jul 21 02:18:55 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:56 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f4711c44-6a51-4814-b9a3-63be6bb40d17" returned: 0 in 0.291s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:18:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:18:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.333s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:18:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-404818216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06115e41-29be-47f2-96c0-7ea6c9e4764e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88bb92473b7746f8aae03068ce42a166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:18:55Z,use_quota=True,user_id='fa8cfca8732541d49110fa3523a265cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:18:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] Creating volume 06115e41-29be-47f2-96c0-7ea6c9e4764e {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:18:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:18:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:18:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:18:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:18:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:18:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:18:56 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:18:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-06115e41-29be-47f2-96c0-7ea6c9e4764e 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e16dd60-f985-469b-a59c-8f6ecdd9b3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4711c44-6a51-4814-b9a3-63be6bb40d17', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:56 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-06115e41-29be-47f2-96c0-7ea6c9e4764e 1073741824 Jul 21 02:18:56 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a02f8929-59a9-49e0-8f2e-0438666be607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:56 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] Volume volume-f4711c44-6a51-4814-b9a3-63be6bb40d17 (f4711c44-6a51-4814-b9a3-63be6bb40d17): created successfully Jul 21 02:18:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a02f8929-59a9-49e0-8f2e-0438666be607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] Flow 'volume_create_manager' (c468689b-767d-496a-bd0f-d4fa8f13a78b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:18:56 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-2635de9c-42c3-4c9b-8dc0-74169188667e tempest-CreateVolumesFromImageTest-1402009570 None] Created volume successfully. Jul 21 02:18:56 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-06115e41-29be-47f2-96c0-7ea6c9e4764e 1073741824" returned: 0 in 0.536s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-06115e41-29be-47f2-96c0-7ea6c9e4764e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:56 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-06115e41-29be-47f2-96c0-7ea6c9e4764e Jul 21 02:18:56 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:56 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bfe0d211-974a-4c91-87d3-881f9d2f2717_z49c5rj9devstack@QuobyteHD /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8511555e-c92b-4a45-a9cf-110dd33a60c0" returned: 0 in 2.094s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:56 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bfe0d211-974a-4c91-87d3-881f9d2f2717_z49c5rj9devstack@QuobyteHD, size 112.00 MB, duration 2.10 sec, destination /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8511555e-c92b-4a45-a9cf-110dd33a60c0 {{(pid=87566) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 02:18:56 devstack cinder-volume[87566]: INFO cinder.image.image_utils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Converted 112.00 MB image at 53.41 MB/s Jul 21 02:18:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8511555e-c92b-4a45-a9cf-110dd33a60c0 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:57 devstack sudo[102331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8511555e-c92b-4a45-a9cf-110dd33a60c0 1G Jul 21 02:18:57 devstack sudo[102331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:57 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-06115e41-29be-47f2-96c0-7ea6c9e4764e" returned: 0 in 0.286s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.693s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-171190197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c40b96e-7fdd-44db-b129-4083ff2e8320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88bb92473b7746f8aae03068ce42a166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:18:55Z,use_quota=True,user_id='fa8cfca8732541d49110fa3523a265cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] Creating volume 7c40b96e-7fdd-44db-b129-4083ff2e8320 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:18:57 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7c40b96e-7fdd-44db-b129-4083ff2e8320 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (192c7b17-d59d-4178-994e-b2f8e16765ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06115e41-29be-47f2-96c0-7ea6c9e4764e', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf3afe9-cedf-4edc-89ac-ff37d4e09665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:57 devstack sudo[102333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7c40b96e-7fdd-44db-b129-4083ff2e8320 1073741824 Jul 21 02:18:57 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:57 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] Volume volume-06115e41-29be-47f2-96c0-7ea6c9e4764e (06115e41-29be-47f2-96c0-7ea6c9e4764e): created successfully Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf3afe9-cedf-4edc-89ac-ff37d4e09665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] Flow 'volume_create_manager' (01def9e2-2d40-4d65-bec9-68f796407ecb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:18:57 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-99b76df9-0921-41d3-800f-fe8954a31f65 tempest-CreateVolumesFromImageTest-1402009570 None] Created volume successfully. Jul 21 02:18:57 devstack sudo[102331]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8511555e-c92b-4a45-a9cf-110dd33a60c0 1G" returned: 0 in 0.400s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG cinder.volume.volume_utils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Downloaded image bfe0d211-974a-4c91-87d3-881f9d2f2717 ((None, [{'url': 'file:///opt/stack/data/glance/images/bfe0d211-974a-4c91-87d3-881f9d2f2717', 'metadata': {}}])) to volume 8511555e-c92b-4a45-a9cf-110dd33a60c0 successfully. {{(pid=87566) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Temporary image bfe0d211-974a-4c91-87d3-881f9d2f2717 for user f71db74fdaa64f8bb1ebe81ed6b00d34 is deleted. {{(pid=87566) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG cinder.volume.volume_utils [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Marking volume 8511555e-c92b-4a45-a9cf-110dd33a60c0 as bootable. {{(pid=87566) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Copying metadata from image bfe0d211-974a-4c91-87d3-881f9d2f2717 to 8511555e-c92b-4a45-a9cf-110dd33a60c0. {{(pid=87566) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Creating volume glance metadata for volume 8511555e-c92b-4a45-a9cf-110dd33a60c0 backed by image bfe0d211-974a-4c91-87d3-881f9d2f2717 with: {'image_id': 'bfe0d211-974a-4c91-87d3-881f9d2f2717', 'image_name': 'tempest-scenario-img--601761177', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87566) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e3cf221-5651-4d35-a3b9-7d652245b784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8511555e-c92b-4a45-a9cf-110dd33a60c0', 'volume_size': 1, 'image_id': 'bfe0d211-974a-4c91-87d3-881f9d2f2717', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfe0d211-974a-4c91-87d3-881f9d2f2717', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--601761177', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0776b570ea7e4b05a5a52c47a6f697e2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bfe0d211-974a-4c91-87d3-881f9d2f2717', 'created_at': datetime.datetime(2026, 7, 21, 0, 18, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 0, 18, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfe0d211-974a-4c91-87d3-881f9d2f2717/file', 'properties': {}}, 'image_service': }' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46266aa4-4d8b-455c-a6ec-744bb2149682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:57 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Volume volume-8511555e-c92b-4a45-a9cf-110dd33a60c0 (8511555e-c92b-4a45-a9cf-110dd33a60c0): created successfully Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46266aa4-4d8b-455c-a6ec-744bb2149682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Flow 'volume_create_manager' (4b06beb0-e784-49f6-a7d5-f6c8136ccff4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:18:57 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-ab156924-bf3f-46eb-936d-0d43035e5d8c tempest-TestInstancesWithCinderVolumes-1617127660 None] Created volume successfully. Jul 21 02:18:57 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7c40b96e-7fdd-44db-b129-4083ff2e8320 1073741824" returned: 0 in 0.592s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7c40b96e-7fdd-44db-b129-4083ff2e8320 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:57 devstack sudo[102343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7c40b96e-7fdd-44db-b129-4083ff2e8320 Jul 21 02:18:57 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:57 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7c40b96e-7fdd-44db-b129-4083ff2e8320" returned: 0 in 0.276s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.259s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-882533132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a8e92d3-0a94-4457-9726-6e880e003857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88bb92473b7746f8aae03068ce42a166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:18:56Z,use_quota=True,user_id='fa8cfca8732541d49110fa3523a265cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] Creating volume 4a8e92d3-0a94-4457-9726-6e880e003857 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:18:57 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:18:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4a8e92d3-0a94-4457-9726-6e880e003857 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:58 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bad386d-4e84-4454-b4bf-071350701b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c40b96e-7fdd-44db-b129-4083ff2e8320', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:58 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (088435b3-2cfc-4f31-9152-f40911209f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:58 devstack sudo[102346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4a8e92d3-0a94-4457-9726-6e880e003857 1073741824 Jul 21 02:18:58 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:58 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] Volume volume-7c40b96e-7fdd-44db-b129-4083ff2e8320 (7c40b96e-7fdd-44db-b129-4083ff2e8320): created successfully Jul 21 02:18:58 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (088435b3-2cfc-4f31-9152-f40911209f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:58 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] Flow 'volume_create_manager' (3bd6f7a1-d41f-4ff6-b60d-370ecd5ba277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:18:58 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-4bd7af23-3dbf-4a23-ad2a-1d4530c37275 tempest-CreateVolumesFromImageTest-1402009570 None] Created volume successfully. Jul 21 02:18:58 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4a8e92d3-0a94-4457-9726-6e880e003857 1073741824" returned: 0 in 0.519s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4a8e92d3-0a94-4457-9726-6e880e003857 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:58 devstack sudo[102353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4a8e92d3-0a94-4457-9726-6e880e003857 Jul 21 02:18:58 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:58 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4a8e92d3-0a94-4457-9726-6e880e003857" returned: 0 in 0.321s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:58 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:18:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:18:58 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5010e8da-5acf-41d4-9d89-39fa6e64c076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a8e92d3-0a94-4457-9726-6e880e003857', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:58 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4ed1444-7779-4e03-a805-0e46ebe6df6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:18:58 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] Volume volume-4a8e92d3-0a94-4457-9726-6e880e003857 (4a8e92d3-0a94-4457-9726-6e880e003857): created successfully Jul 21 02:18:58 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4ed1444-7779-4e03-a805-0e46ebe6df6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:18:58 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] Flow 'volume_create_manager' (68bc552f-e55f-460a-9747-c8ff7f0450e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:18:58 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-b89bb93d-3fa5-4d65-9ad5-99d24e4c3061 tempest-CreateVolumesFromImageTest-1402009570 None] Created volume successfully. Jul 21 02:18:59 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1d350cdc-eb7c-465c-a529-f1310319641e tempest-CreateVolumesFromImageTest-1402009570 None] Acquiring lock "cinder-4a8e92d3-0a94-4457-9726-6e880e003857-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:18:59 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1d350cdc-eb7c-465c-a529-f1310319641e tempest-CreateVolumesFromImageTest-1402009570 None] Lock "cinder-4a8e92d3-0a94-4457-9726-6e880e003857-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:18:59 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1d350cdc-eb7c-465c-a529-f1310319641e tempest-CreateVolumesFromImageTest-1402009570 None] Acquiring lock "cinder-quobyte-4a8e92d3-0a94-4457-9726-6e880e003857" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:18:59 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1d350cdc-eb7c-465c-a529-f1310319641e tempest-CreateVolumesFromImageTest-1402009570 None] Lock "cinder-quobyte-4a8e92d3-0a94-4457-9726-6e880e003857" acquired by "delete_volume" :: waited 0.024s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:18:59 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ba26df-4dfa-4cd7-9cf7-7663288740ce]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:18:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1d350cdc-eb7c-465c-a529-f1310319641e tempest-CreateVolumesFromImageTest-1402009570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4a8e92d3-0a94-4457-9726-6e880e003857 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:59 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4a8e92d3-0a94-4457-9726-6e880e003857 Jul 21 02:18:59 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:59 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1d350cdc-eb7c-465c-a529-f1310319641e tempest-CreateVolumesFromImageTest-1402009570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4a8e92d3-0a94-4457-9726-6e880e003857" returned: 0 in 0.464s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1d350cdc-eb7c-465c-a529-f1310319641e tempest-CreateVolumesFromImageTest-1402009570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4a8e92d3-0a94-4457-9726-6e880e003857 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:18:59 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4a8e92d3-0a94-4457-9726-6e880e003857 Jul 21 02:18:59 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:18:59 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Jul 21 02:18:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1d350cdc-eb7c-465c-a529-f1310319641e tempest-CreateVolumesFromImageTest-1402009570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4a8e92d3-0a94-4457-9726-6e880e003857" returned: 0 in 0.280s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:18:59 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1d350cdc-eb7c-465c-a529-f1310319641e tempest-CreateVolumesFromImageTest-1402009570 None] Lock "cinder-quobyte-4a8e92d3-0a94-4457-9726-6e880e003857" released by "delete_volume" :: held 0.815s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:00 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-1d350cdc-eb7c-465c-a529-f1310319641e tempest-CreateVolumesFromImageTest-1402009570 None] Created reservations ['35234b0d-f78a-4df1-a90b-328e7f5a52d2', '511fca37-76ba-46c1-9758-8c0d3be8af2f', '1f547d75-80dc-411e-aebe-42264f47772d', 'f7b786b6-f06a-4ae2-b583-487b2d237511'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:19:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-1d350cdc-eb7c-465c-a529-f1310319641e tempest-CreateVolumesFromImageTest-1402009570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-1d350cdc-eb7c-465c-a529-f1310319641e tempest-CreateVolumesFromImageTest-1402009570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:00 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-1d350cdc-eb7c-465c-a529-f1310319641e tempest-CreateVolumesFromImageTest-1402009570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:00 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-1d350cdc-eb7c-465c-a529-f1310319641e tempest-CreateVolumesFromImageTest-1402009570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-1d350cdc-eb7c-465c-a529-f1310319641e tempest-CreateVolumesFromImageTest-1402009570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1d350cdc-eb7c-465c-a529-f1310319641e tempest-CreateVolumesFromImageTest-1402009570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:00 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:19:00 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:00 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-876ad33d-098b-46a3-b648-58bd8ab9359a tempest-CreateVolumesFromImageTest-1402009570 None] Acquiring lock "cinder-7c40b96e-7fdd-44db-b129-4083ff2e8320-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:00 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-876ad33d-098b-46a3-b648-58bd8ab9359a tempest-CreateVolumesFromImageTest-1402009570 None] Lock "cinder-7c40b96e-7fdd-44db-b129-4083ff2e8320-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:00 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-876ad33d-098b-46a3-b648-58bd8ab9359a tempest-CreateVolumesFromImageTest-1402009570 None] Acquiring lock "cinder-quobyte-7c40b96e-7fdd-44db-b129-4083ff2e8320" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:00 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-876ad33d-098b-46a3-b648-58bd8ab9359a tempest-CreateVolumesFromImageTest-1402009570 None] Lock "cinder-quobyte-7c40b96e-7fdd-44db-b129-4083ff2e8320" acquired by "delete_volume" :: waited 0.023s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:00 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd09f94d-5c12-4371-a295-f6bf494c3a20]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:19:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-876ad33d-098b-46a3-b648-58bd8ab9359a tempest-CreateVolumesFromImageTest-1402009570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7c40b96e-7fdd-44db-b129-4083ff2e8320 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:00 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1d350cdc-eb7c-465c-a529-f1310319641e tempest-CreateVolumesFromImageTest-1402009570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.503s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:00 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-1d350cdc-eb7c-465c-a529-f1310319641e tempest-CreateVolumesFromImageTest-1402009570 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:19:00 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-1d350cdc-eb7c-465c-a529-f1310319641e tempest-CreateVolumesFromImageTest-1402009570 None] Deleted volume successfully. Jul 21 02:19:00 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1d350cdc-eb7c-465c-a529-f1310319641e tempest-CreateVolumesFromImageTest-1402009570 None] Lock "cinder-4a8e92d3-0a94-4457-9726-6e880e003857-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:00 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7c40b96e-7fdd-44db-b129-4083ff2e8320 Jul 21 02:19:00 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-1b8dce25-e0cc-42f7-b72e-bf0abbd09e1e req-e96063e9-b175-43e7-bae5-44746290424b tempest-TestInstancesWithCinderVolumes-1617127660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-1b8dce25-e0cc-42f7-b72e-bf0abbd09e1e req-e96063e9-b175-43e7-bae5-44746290424b tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-1b8dce25-e0cc-42f7-b72e-bf0abbd09e1e req-e96063e9-b175-43e7-bae5-44746290424b tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:01 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-876ad33d-098b-46a3-b648-58bd8ab9359a tempest-CreateVolumesFromImageTest-1402009570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7c40b96e-7fdd-44db-b129-4083ff2e8320" returned: 0 in 0.550s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-876ad33d-098b-46a3-b648-58bd8ab9359a tempest-CreateVolumesFromImageTest-1402009570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7c40b96e-7fdd-44db-b129-4083ff2e8320 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:01 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7c40b96e-7fdd-44db-b129-4083ff2e8320 Jul 21 02:19:01 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:01 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-1b8dce25-e0cc-42f7-b72e-bf0abbd09e1e req-e96063e9-b175-43e7-bae5-44746290424b tempest-TestInstancesWithCinderVolumes-1617127660 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea', 'name': 'volume-8511555e-c92b-4a45-a9cf-110dd33a60c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c9b49951-fcc3-4756-8a33-63132a492305', 'enforce_multipath': True} {{(pid=87566) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 02:19:01 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-1b8dce25-e0cc-42f7-b72e-bf0abbd09e1e req-e96063e9-b175-43e7-bae5-44746290424b tempest-TestInstancesWithCinderVolumes-1617127660 None] attachment_update completed successfully. Jul 21 02:19:01 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-876ad33d-098b-46a3-b648-58bd8ab9359a tempest-CreateVolumesFromImageTest-1402009570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7c40b96e-7fdd-44db-b129-4083ff2e8320" returned: 0 in 0.472s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-876ad33d-098b-46a3-b648-58bd8ab9359a tempest-CreateVolumesFromImageTest-1402009570 None] Lock "cinder-quobyte-7c40b96e-7fdd-44db-b129-4083ff2e8320" released by "delete_volume" :: held 1.099s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:01 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-876ad33d-098b-46a3-b648-58bd8ab9359a tempest-CreateVolumesFromImageTest-1402009570 None] Created reservations ['9fd7ff77-f204-4003-a291-6c7edd14c99c', '4f729f6e-cab0-471f-862b-a4027d9715ba', '2e9961db-82bc-4e29-bd13-5adf4972a264', '482ad4d9-90fe-4960-9407-351eb3071738'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:19:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-876ad33d-098b-46a3-b648-58bd8ab9359a tempest-CreateVolumesFromImageTest-1402009570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-876ad33d-098b-46a3-b648-58bd8ab9359a tempest-CreateVolumesFromImageTest-1402009570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:01 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-876ad33d-098b-46a3-b648-58bd8ab9359a tempest-CreateVolumesFromImageTest-1402009570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:01 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-876ad33d-098b-46a3-b648-58bd8ab9359a tempest-CreateVolumesFromImageTest-1402009570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-876ad33d-098b-46a3-b648-58bd8ab9359a tempest-CreateVolumesFromImageTest-1402009570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-876ad33d-098b-46a3-b648-58bd8ab9359a tempest-CreateVolumesFromImageTest-1402009570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:01 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:19:01 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:02 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-876ad33d-098b-46a3-b648-58bd8ab9359a tempest-CreateVolumesFromImageTest-1402009570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.298s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:02 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-876ad33d-098b-46a3-b648-58bd8ab9359a tempest-CreateVolumesFromImageTest-1402009570 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:19:02 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-876ad33d-098b-46a3-b648-58bd8ab9359a tempest-CreateVolumesFromImageTest-1402009570 None] Deleted volume successfully. Jul 21 02:19:02 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-876ad33d-098b-46a3-b648-58bd8ab9359a tempest-CreateVolumesFromImageTest-1402009570 None] Lock "cinder-7c40b96e-7fdd-44db-b129-4083ff2e8320-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:02 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-0c3a9079-a0d7-4d84-b0c4-7b4e5ca8075b tempest-CreateVolumesFromImageTest-1402009570 None] Acquiring lock "cinder-06115e41-29be-47f2-96c0-7ea6c9e4764e-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:02 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-0c3a9079-a0d7-4d84-b0c4-7b4e5ca8075b tempest-CreateVolumesFromImageTest-1402009570 None] Lock "cinder-06115e41-29be-47f2-96c0-7ea6c9e4764e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:02 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-0c3a9079-a0d7-4d84-b0c4-7b4e5ca8075b tempest-CreateVolumesFromImageTest-1402009570 None] Acquiring lock "cinder-quobyte-06115e41-29be-47f2-96c0-7ea6c9e4764e" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:02 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:19:02 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Flow 'volume_create_manager' (08940dff-ece9-4491-9ce5-bf5fa6908523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:19:02 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa89119f-a213-44c9-86df-e39027d4ce05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:02 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-0c3a9079-a0d7-4d84-b0c4-7b4e5ca8075b tempest-CreateVolumesFromImageTest-1402009570 None] Lock "cinder-quobyte-06115e41-29be-47f2-96c0-7ea6c9e4764e" acquired by "delete_volume" :: waited 0.071s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:02 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa89119f-a213-44c9-86df-e39027d4ce05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1648736642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f33aee5-7899-4d49-8443-c98ae237bde2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='131539cd18c24f9f91bfa38c33e3cabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:19:03Z,use_quota=True,user_id='844a34fd8f64409db7cc2bc6f89c3322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:02 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dfa9267-8120-4dca-9d7b-e0a8926227eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:02 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dfa9267-8120-4dca-9d7b-e0a8926227eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:02 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (965f60c1-e57e-4d91-854b-3bf0391a94f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:02 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (965f60c1-e57e-4d91-854b-3bf0391a94f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f33aee5-7899-4d49-8443-c98ae237bde2', 'volume_name': 'volume-1f33aee5-7899-4d49-8443-c98ae237bde2', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:02 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92219ca-50ca-4b28-8c58-d06dd88da441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:02 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92219ca-50ca-4b28-8c58-d06dd88da441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:02 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d41734d7-b497-4691-8ed4-5ddb3734ecbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:02 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Volume 1f33aee5-7899-4d49-8443-c98ae237bde2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f33aee5-7899-4d49-8443-c98ae237bde2', 'volume_size': 1} Jul 21 02:19:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:02 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1648736642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f33aee5-7899-4d49-8443-c98ae237bde2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='131539cd18c24f9f91bfa38c33e3cabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:19:03Z,use_quota=True,user_id='844a34fd8f64409db7cc2bc6f89c3322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:19:02 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Creating volume 1f33aee5-7899-4d49-8443-c98ae237bde2 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:19:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:02 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:02 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:02 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:19:02 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:19:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:02 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0db2cc-ce30-4417-8016-c42495d643d0]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:19:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0c3a9079-a0d7-4d84-b0c4-7b4e5ca8075b tempest-CreateVolumesFromImageTest-1402009570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-06115e41-29be-47f2-96c0-7ea6c9e4764e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:02 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2 1073741824 Jul 21 02:19:02 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:02 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-06115e41-29be-47f2-96c0-7ea6c9e4764e Jul 21 02:19:03 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:03 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0c3a9079-a0d7-4d84-b0c4-7b4e5ca8075b tempest-CreateVolumesFromImageTest-1402009570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-06115e41-29be-47f2-96c0-7ea6c9e4764e" returned: 0 in 0.436s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0c3a9079-a0d7-4d84-b0c4-7b4e5ca8075b tempest-CreateVolumesFromImageTest-1402009570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-06115e41-29be-47f2-96c0-7ea6c9e4764e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:03 devstack sudo[102403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-06115e41-29be-47f2-96c0-7ea6c9e4764e Jul 21 02:19:03 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:03 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2 1073741824" returned: 0 in 0.554s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:03 devstack sudo[102450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2 Jul 21 02:19:03 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:03 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0c3a9079-a0d7-4d84-b0c4-7b4e5ca8075b tempest-CreateVolumesFromImageTest-1402009570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-06115e41-29be-47f2-96c0-7ea6c9e4764e" returned: 0 in 0.314s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-0c3a9079-a0d7-4d84-b0c4-7b4e5ca8075b tempest-CreateVolumesFromImageTest-1402009570 None] Lock "cinder-quobyte-06115e41-29be-47f2-96c0-7ea6c9e4764e" released by "delete_volume" :: held 0.869s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:03 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-0c3a9079-a0d7-4d84-b0c4-7b4e5ca8075b tempest-CreateVolumesFromImageTest-1402009570 None] Created reservations ['260a6a28-eed3-41ab-9125-9b4846b2363d', '1c8a43b0-02f4-487d-acac-056c1cf5f66b', '04dfafa4-6f21-45e9-8bf2-a9da41f2785b', 'ff43625a-24ff-4382-a9cd-3ecce7af0976'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:19:03 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0c3a9079-a0d7-4d84-b0c4-7b4e5ca8075b tempest-CreateVolumesFromImageTest-1402009570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0c3a9079-a0d7-4d84-b0c4-7b4e5ca8075b tempest-CreateVolumesFromImageTest-1402009570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:03 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0c3a9079-a0d7-4d84-b0c4-7b4e5ca8075b tempest-CreateVolumesFromImageTest-1402009570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:03 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0c3a9079-a0d7-4d84-b0c4-7b4e5ca8075b tempest-CreateVolumesFromImageTest-1402009570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0c3a9079-a0d7-4d84-b0c4-7b4e5ca8075b tempest-CreateVolumesFromImageTest-1402009570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0c3a9079-a0d7-4d84-b0c4-7b4e5ca8075b tempest-CreateVolumesFromImageTest-1402009570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2" returned: 0 in 0.536s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:04 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:19:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:04 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:19:04 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d41734d7-b497-4691-8ed4-5ddb3734ecbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f33aee5-7899-4d49-8443-c98ae237bde2', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9c87763-59bc-48b8-a1c7-6a7c4229b598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:04 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-44ca2927-2bcf-4ed1-814e-2b22ff2a68d2 tempest-CreateVolumesFromImageTest-1402009570 None] Acquiring lock "cinder-f4711c44-6a51-4814-b9a3-63be6bb40d17-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:04 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Volume volume-1f33aee5-7899-4d49-8443-c98ae237bde2 (1f33aee5-7899-4d49-8443-c98ae237bde2): created successfully Jul 21 02:19:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9c87763-59bc-48b8-a1c7-6a7c4229b598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Flow 'volume_create_manager' (08940dff-ece9-4491-9ce5-bf5fa6908523) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:19:04 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-44ca2927-2bcf-4ed1-814e-2b22ff2a68d2 tempest-CreateVolumesFromImageTest-1402009570 None] Lock "cinder-f4711c44-6a51-4814-b9a3-63be6bb40d17-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:04 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-5eb0b2b2-2835-4e1a-9387-b131f82d43f3 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Created volume successfully. Jul 21 02:19:04 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-44ca2927-2bcf-4ed1-814e-2b22ff2a68d2 tempest-CreateVolumesFromImageTest-1402009570 None] Acquiring lock "cinder-quobyte-f4711c44-6a51-4814-b9a3-63be6bb40d17" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:04 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-44ca2927-2bcf-4ed1-814e-2b22ff2a68d2 tempest-CreateVolumesFromImageTest-1402009570 None] Lock "cinder-quobyte-f4711c44-6a51-4814-b9a3-63be6bb40d17" acquired by "delete_volume" :: waited 0.029s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:04 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0c68f4-85f5-4680-b665-0d67b5b6f15d]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:19:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-44ca2927-2bcf-4ed1-814e-2b22ff2a68d2 tempest-CreateVolumesFromImageTest-1402009570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f4711c44-6a51-4814-b9a3-63be6bb40d17 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:04 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0c3a9079-a0d7-4d84-b0c4-7b4e5ca8075b tempest-CreateVolumesFromImageTest-1402009570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.466s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:04 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-0c3a9079-a0d7-4d84-b0c4-7b4e5ca8075b tempest-CreateVolumesFromImageTest-1402009570 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:19:04 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-0c3a9079-a0d7-4d84-b0c4-7b4e5ca8075b tempest-CreateVolumesFromImageTest-1402009570 None] Deleted volume successfully. Jul 21 02:19:04 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f4711c44-6a51-4814-b9a3-63be6bb40d17 Jul 21 02:19:04 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:04 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-0c3a9079-a0d7-4d84-b0c4-7b4e5ca8075b tempest-CreateVolumesFromImageTest-1402009570 None] Lock "cinder-06115e41-29be-47f2-96c0-7ea6c9e4764e-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:05 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-44ca2927-2bcf-4ed1-814e-2b22ff2a68d2 tempest-CreateVolumesFromImageTest-1402009570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f4711c44-6a51-4814-b9a3-63be6bb40d17" returned: 0 in 0.747s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-44ca2927-2bcf-4ed1-814e-2b22ff2a68d2 tempest-CreateVolumesFromImageTest-1402009570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f4711c44-6a51-4814-b9a3-63be6bb40d17 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:05 devstack sudo[102868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f4711c44-6a51-4814-b9a3-63be6bb40d17 Jul 21 02:19:05 devstack sudo[102868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:05 devstack sudo[102868]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-44ca2927-2bcf-4ed1-814e-2b22ff2a68d2 tempest-CreateVolumesFromImageTest-1402009570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f4711c44-6a51-4814-b9a3-63be6bb40d17" returned: 0 in 0.318s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:05 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-44ca2927-2bcf-4ed1-814e-2b22ff2a68d2 tempest-CreateVolumesFromImageTest-1402009570 None] Lock "cinder-quobyte-f4711c44-6a51-4814-b9a3-63be6bb40d17" released by "delete_volume" :: held 1.138s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dc5fdfdc-edb3-48d5-9b4a-550f4cdb4d04 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dc5fdfdc-edb3-48d5-9b4a-550f4cdb4d04 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-dc5fdfdc-edb3-48d5-9b4a-550f4cdb4d04 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Creating offline snapshot 056899d7-dc9d-4a89-aaa4-11fe32fb64ed of volume 1f33aee5-7899-4d49-8443-c98ae237bde2 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:19:05 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab148af8-42fc-452a-a9cb-f6562115358c]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:19:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dc5fdfdc-edb3-48d5-9b4a-550f4cdb4d04 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:05 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-44ca2927-2bcf-4ed1-814e-2b22ff2a68d2 tempest-CreateVolumesFromImageTest-1402009570 None] Created reservations ['0d9701df-719e-4198-9a9f-b746439eea67', '87f80894-e15d-4c34-b929-112eebad1b15', '891c37a7-977b-4873-8ad3-265b21e9ad0a', '816cf70e-0598-42b0-a297-8144ca3953a0'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:19:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-44ca2927-2bcf-4ed1-814e-2b22ff2a68d2 tempest-CreateVolumesFromImageTest-1402009570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-44ca2927-2bcf-4ed1-814e-2b22ff2a68d2 tempest-CreateVolumesFromImageTest-1402009570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-44ca2927-2bcf-4ed1-814e-2b22ff2a68d2 tempest-CreateVolumesFromImageTest-1402009570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-44ca2927-2bcf-4ed1-814e-2b22ff2a68d2 tempest-CreateVolumesFromImageTest-1402009570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-44ca2927-2bcf-4ed1-814e-2b22ff2a68d2 tempest-CreateVolumesFromImageTest-1402009570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-44ca2927-2bcf-4ed1-814e-2b22ff2a68d2 tempest-CreateVolumesFromImageTest-1402009570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:05 devstack sudo[102871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2 Jul 21 02:19:05 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:05 devstack sudo[102872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:19:05 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:05 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dc5fdfdc-edb3-48d5-9b4a-550f4cdb4d04 tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2" returned: 0 in 0.468s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dc5fdfdc-edb3-48d5-9b4a-550f4cdb4d04 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2.056899d7-dc9d-4a89-aaa4-11fe32fb64ed 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:05 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-44ca2927-2bcf-4ed1-814e-2b22ff2a68d2 tempest-CreateVolumesFromImageTest-1402009570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.381s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:05 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-44ca2927-2bcf-4ed1-814e-2b22ff2a68d2 tempest-CreateVolumesFromImageTest-1402009570 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:19:05 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-44ca2927-2bcf-4ed1-814e-2b22ff2a68d2 tempest-CreateVolumesFromImageTest-1402009570 None] Deleted volume successfully. Jul 21 02:19:05 devstack sudo[102881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2.056899d7-dc9d-4a89-aaa4-11fe32fb64ed 1G Jul 21 02:19:05 devstack sudo[102881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:05 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-44ca2927-2bcf-4ed1-814e-2b22ff2a68d2 tempest-CreateVolumesFromImageTest-1402009570 None] Lock "cinder-f4711c44-6a51-4814-b9a3-63be6bb40d17-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:06 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f28cb86c-eeff-4eb5-b311-f84d95fd139d tempest-CreateVolumesFromImageTest-1402009570 None] Acquiring lock "cinder-f049228d-9e4c-47e8-85af-e15636be4701-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:06 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f28cb86c-eeff-4eb5-b311-f84d95fd139d tempest-CreateVolumesFromImageTest-1402009570 None] Lock "cinder-f049228d-9e4c-47e8-85af-e15636be4701-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:06 devstack sudo[102881]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dc5fdfdc-edb3-48d5-9b4a-550f4cdb4d04 tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2.056899d7-dc9d-4a89-aaa4-11fe32fb64ed 1G" returned: 0 in 0.555s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dc5fdfdc-edb3-48d5-9b4a-550f4cdb4d04 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f33aee5-7899-4d49-8443-c98ae237bde2 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2.056899d7-dc9d-4a89-aaa4-11fe32fb64ed {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:06 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f28cb86c-eeff-4eb5-b311-f84d95fd139d tempest-CreateVolumesFromImageTest-1402009570 None] Acquiring lock "cinder-quobyte-f049228d-9e4c-47e8-85af-e15636be4701" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:06 devstack sudo[102887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f33aee5-7899-4d49-8443-c98ae237bde2 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2.056899d7-dc9d-4a89-aaa4-11fe32fb64ed Jul 21 02:19:06 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:06 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f28cb86c-eeff-4eb5-b311-f84d95fd139d tempest-CreateVolumesFromImageTest-1402009570 None] Lock "cinder-quobyte-f049228d-9e4c-47e8-85af-e15636be4701" acquired by "delete_volume" :: waited 0.022s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:06 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[24481140-9d50-436e-9a63-c928a4e441a6]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:19:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f28cb86c-eeff-4eb5-b311-f84d95fd139d tempest-CreateVolumesFromImageTest-1402009570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f049228d-9e4c-47e8-85af-e15636be4701 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:06 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f049228d-9e4c-47e8-85af-e15636be4701 Jul 21 02:19:06 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:06 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dc5fdfdc-edb3-48d5-9b4a-550f4cdb4d04 tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f33aee5-7899-4d49-8443-c98ae237bde2 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2.056899d7-dc9d-4a89-aaa4-11fe32fb64ed" returned: 0 in 0.311s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:06 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-dc5fdfdc-edb3-48d5-9b4a-550f4cdb4d04 tempest-CreateVolumesFromSnapshotTest-1909230096 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2.056899d7-dc9d-4a89-aaa4-11fe32fb64ed is being set with open permissions: ugo+rw Jul 21 02:19:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dc5fdfdc-edb3-48d5-9b4a-550f4cdb4d04 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2.056899d7-dc9d-4a89-aaa4-11fe32fb64ed {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:06 devstack sudo[102894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2.056899d7-dc9d-4a89-aaa4-11fe32fb64ed Jul 21 02:19:06 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:06 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f28cb86c-eeff-4eb5-b311-f84d95fd139d tempest-CreateVolumesFromImageTest-1402009570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f049228d-9e4c-47e8-85af-e15636be4701" returned: 0 in 0.429s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f28cb86c-eeff-4eb5-b311-f84d95fd139d tempest-CreateVolumesFromImageTest-1402009570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f049228d-9e4c-47e8-85af-e15636be4701 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:06 devstack sudo[102899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f049228d-9e4c-47e8-85af-e15636be4701 Jul 21 02:19:06 devstack sudo[102899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:07 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dc5fdfdc-edb3-48d5-9b4a-550f4cdb4d04 tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2.056899d7-dc9d-4a89-aaa4-11fe32fb64ed" returned: 0 in 0.289s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dc5fdfdc-edb3-48d5-9b4a-550f4cdb4d04 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:07 devstack sudo[102902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2.info Jul 21 02:19:07 devstack sudo[102902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:07 devstack sudo[102899]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f28cb86c-eeff-4eb5-b311-f84d95fd139d tempest-CreateVolumesFromImageTest-1402009570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f049228d-9e4c-47e8-85af-e15636be4701" returned: 0 in 0.308s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:07 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f28cb86c-eeff-4eb5-b311-f84d95fd139d tempest-CreateVolumesFromImageTest-1402009570 None] Lock "cinder-quobyte-f049228d-9e4c-47e8-85af-e15636be4701" released by "delete_volume" :: held 0.786s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:07 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-f28cb86c-eeff-4eb5-b311-f84d95fd139d tempest-CreateVolumesFromImageTest-1402009570 None] Created reservations ['251e74a9-1488-4107-a744-e5279ed0e2e1', 'da468d9d-30d2-4d7d-98ff-626713ee41c8', '4a12d1a0-e201-4a49-aada-93f6e2d00596', '154f5f38-ff37-4431-9ef4-65fb80f2fbb1'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:19:07 devstack sudo[102902]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dc5fdfdc-edb3-48d5-9b4a-550f4cdb4d04 tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2.info" returned: 0 in 0.349s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:07 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-dc5fdfdc-edb3-48d5-9b4a-550f4cdb4d04 tempest-CreateVolumesFromSnapshotTest-1909230096 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2.info is being set with open permissions: ugo+rw Jul 21 02:19:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dc5fdfdc-edb3-48d5-9b4a-550f4cdb4d04 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:07 devstack sudo[102906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2.info Jul 21 02:19:07 devstack sudo[102906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f28cb86c-eeff-4eb5-b311-f84d95fd139d tempest-CreateVolumesFromImageTest-1402009570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f28cb86c-eeff-4eb5-b311-f84d95fd139d tempest-CreateVolumesFromImageTest-1402009570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:07 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f28cb86c-eeff-4eb5-b311-f84d95fd139d tempest-CreateVolumesFromImageTest-1402009570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:07 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f28cb86c-eeff-4eb5-b311-f84d95fd139d tempest-CreateVolumesFromImageTest-1402009570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f28cb86c-eeff-4eb5-b311-f84d95fd139d tempest-CreateVolumesFromImageTest-1402009570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f28cb86c-eeff-4eb5-b311-f84d95fd139d tempest-CreateVolumesFromImageTest-1402009570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:07 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:19:07 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:07 devstack sudo[102906]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dc5fdfdc-edb3-48d5-9b4a-550f4cdb4d04 tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2.info" returned: 0 in 0.466s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dc5fdfdc-edb3-48d5-9b4a-550f4cdb4d04 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.574s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:07 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f28cb86c-eeff-4eb5-b311-f84d95fd139d tempest-CreateVolumesFromImageTest-1402009570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.399s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:07 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-f28cb86c-eeff-4eb5-b311-f84d95fd139d tempest-CreateVolumesFromImageTest-1402009570 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:19:08 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-f28cb86c-eeff-4eb5-b311-f84d95fd139d tempest-CreateVolumesFromImageTest-1402009570 None] Deleted volume successfully. Jul 21 02:19:08 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-dc5fdfdc-edb3-48d5-9b4a-550f4cdb4d04 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Create snapshot completed successfully Jul 21 02:19:08 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f28cb86c-eeff-4eb5-b311-f84d95fd139d tempest-CreateVolumesFromImageTest-1402009570 None] Lock "cinder-f049228d-9e4c-47e8-85af-e15636be4701-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Flow 'volume_create_manager' (6c6ffd6d-a587-4acd-aa2c-ddb1bf88ed43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (631c4a61-acdc-4b3b-a8ed-b60c42bf2bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (631c4a61-acdc-4b3b-a8ed-b60c42bf2bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1482784855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b34f25d8-0827-4801-a71b-f4b2199dd3f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='131539cd18c24f9f91bfa38c33e3cabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:19:09Z,use_quota=True,user_id='844a34fd8f64409db7cc2bc6f89c3322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca125c80-fd57-4bbe-8318-ccaa235766ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca125c80-fd57-4bbe-8318-ccaa235766ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a19ade6-50d9-4f38-8116-79f7f441de20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a19ade6-50d9-4f38-8116-79f7f441de20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b34f25d8-0827-4801-a71b-f4b2199dd3f9', 'volume_name': 'volume-b34f25d8-0827-4801-a71b-f4b2199dd3f9', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83af5219-78b0-4216-9f3c-483ed7809753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83af5219-78b0-4216-9f3c-483ed7809753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb76569e-d091-4d9d-b960-5685454bd250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:09 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Volume b34f25d8-0827-4801-a71b-f4b2199dd3f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b34f25d8-0827-4801-a71b-f4b2199dd3f9', 'volume_size': 1} Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1482784855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b34f25d8-0827-4801-a71b-f4b2199dd3f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='131539cd18c24f9f91bfa38c33e3cabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:19:09Z,use_quota=True,user_id='844a34fd8f64409db7cc2bc6f89c3322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Creating volume b34f25d8-0827-4801-a71b-f4b2199dd3f9 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:19:09 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b34f25d8-0827-4801-a71b-f4b2199dd3f9 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:09 devstack sudo[102912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b34f25d8-0827-4801-a71b-f4b2199dd3f9 1073741824 Jul 21 02:19:09 devstack sudo[102912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Flow 'volume_create_manager' (084e7b2a-89f0-4e53-8d1c-e5b2e84a4dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a10b52cb-c390-44c7-b24f-eb282b2869e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a10b52cb-c390-44c7-b24f-eb282b2869e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-583295745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea993fd-0079-4f14-812c-1045a05d5168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='131539cd18c24f9f91bfa38c33e3cabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:19:10Z,use_quota=True,user_id='844a34fd8f64409db7cc2bc6f89c3322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (824de4c1-c0f9-48ee-b2e7-3c45329877f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (824de4c1-c0f9-48ee-b2e7-3c45329877f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c00b3ed-7361-40e6-9a00-8d5c400d8a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c00b3ed-7361-40e6-9a00-8d5c400d8a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ea993fd-0079-4f14-812c-1045a05d5168', 'volume_name': 'volume-8ea993fd-0079-4f14-812c-1045a05d5168', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (845fdba7-1529-483c-81a4-f31e3d585542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (845fdba7-1529-483c-81a4-f31e3d585542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42d0cc3f-200b-475d-84d2-045ddb8c1b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:09 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Volume 8ea993fd-0079-4f14-812c-1045a05d5168: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ea993fd-0079-4f14-812c-1045a05d5168', 'volume_size': 1} Jul 21 02:19:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:10 devstack sudo[102912]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b34f25d8-0827-4801-a71b-f4b2199dd3f9 1073741824" returned: 0 in 0.929s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b34f25d8-0827-4801-a71b-f4b2199dd3f9 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:10 devstack sudo[102917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b34f25d8-0827-4801-a71b-f4b2199dd3f9 Jul 21 02:19:10 devstack sudo[102917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:10 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:19:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Flow 'volume_create_manager' (9c12c2db-a966-4b3f-a0de-a94d18731193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:19:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96cd6100-7241-4a0c-ac45-65b632ef8611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96cd6100-7241-4a0c-ac45-65b632ef8611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-779656147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e905f7e-3754-45ed-8fb1-df4341d4a7e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='131539cd18c24f9f91bfa38c33e3cabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:19:10Z,use_quota=True,user_id='844a34fd8f64409db7cc2bc6f89c3322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a2f2c0a-eacb-4af8-939c-f2b15be4fa8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a2f2c0a-eacb-4af8-939c-f2b15be4fa8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f66cf13d-5b1b-4416-a142-274eb441fdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f66cf13d-5b1b-4416-a142-274eb441fdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e905f7e-3754-45ed-8fb1-df4341d4a7e2', 'volume_name': 'volume-7e905f7e-3754-45ed-8fb1-df4341d4a7e2', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e2c122-4de9-434c-b9db-5ad91be91832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e2c122-4de9-434c-b9db-5ad91be91832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d716aa9c-c219-4fde-9aa4-731ad3e53c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:10 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Volume 7e905f7e-3754-45ed-8fb1-df4341d4a7e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e905f7e-3754-45ed-8fb1-df4341d4a7e2', 'volume_size': 1} Jul 21 02:19:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:10 devstack sudo[102917]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b34f25d8-0827-4801-a71b-f4b2199dd3f9" returned: 0 in 0.634s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:10 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:19:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.085s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:10 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-583295745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea993fd-0079-4f14-812c-1045a05d5168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='131539cd18c24f9f91bfa38c33e3cabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:19:10Z,use_quota=True,user_id='844a34fd8f64409db7cc2bc6f89c3322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:19:11 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Creating volume 8ea993fd-0079-4f14-812c-1045a05d5168 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:19:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:11 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:11 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:11 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:19:11 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:19:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8ea993fd-0079-4f14-812c-1045a05d5168 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb76569e-d091-4d9d-b960-5685454bd250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b34f25d8-0827-4801-a71b-f4b2199dd3f9', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:11 devstack sudo[102921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8ea993fd-0079-4f14-812c-1045a05d5168 1073741824 Jul 21 02:19:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (256abbc7-a44e-47f5-b0e1-2870f21449a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:11 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:11 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Volume volume-b34f25d8-0827-4801-a71b-f4b2199dd3f9 (b34f25d8-0827-4801-a71b-f4b2199dd3f9): created successfully Jul 21 02:19:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (256abbc7-a44e-47f5-b0e1-2870f21449a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Flow 'volume_create_manager' (6c6ffd6d-a587-4acd-aa2c-ddb1bf88ed43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:19:11 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-8c6e3dc4-18f5-47dd-97f7-062dcaaba294 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Created volume successfully. Jul 21 02:19:11 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:19:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Flow 'volume_create_manager' (1a4a3078-51ac-4276-b7b2-8973f244d1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:19:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab519351-c657-45bd-8407-73fb597b9f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab519351-c657-45bd-8407-73fb597b9f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1393119011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=face193e-2935-4a91-9000-9b89c1bc8ba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='131539cd18c24f9f91bfa38c33e3cabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:19:11Z,use_quota=True,user_id='844a34fd8f64409db7cc2bc6f89c3322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df56379-3a7c-4651-9e28-68e71852b239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df56379-3a7c-4651-9e28-68e71852b239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0617d1c-e741-4e6e-8666-b22640f767c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0617d1c-e741-4e6e-8666-b22640f767c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'face193e-2935-4a91-9000-9b89c1bc8ba9', 'volume_name': 'volume-face193e-2935-4a91-9000-9b89c1bc8ba9', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92798168-6e87-4228-b87d-2d341188af50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92798168-6e87-4228-b87d-2d341188af50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d637f66d-c6e2-4b3e-a994-1e8281b04f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:11 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Volume face193e-2935-4a91-9000-9b89c1bc8ba9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-face193e-2935-4a91-9000-9b89c1bc8ba9', 'volume_size': 1} Jul 21 02:19:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:12 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8ea993fd-0079-4f14-812c-1045a05d5168 1073741824" returned: 0 in 0.995s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8ea993fd-0079-4f14-812c-1045a05d5168 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:12 devstack sudo[102928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8ea993fd-0079-4f14-812c-1045a05d5168 Jul 21 02:19:12 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:12 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:UPDATE=111,cinder:SELECT=121,cinder:INSERT=20,cinder:DELETE=9 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:19:12 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=99,cinder:INSERT=38,cinder:UPDATE=124,cinder:DELETE=12 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:19:12 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:19:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Flow 'volume_create_manager' (edb9cd06-4128-4762-99f1-314b651d23e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:19:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c63d31b-8504-4200-87a7-4b34b499f258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c63d31b-8504-4200-87a7-4b34b499f258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1352526800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e42be479-3092-41fb-8a8d-8302f0a9461c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='131539cd18c24f9f91bfa38c33e3cabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:19:12Z,use_quota=True,user_id='844a34fd8f64409db7cc2bc6f89c3322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ace8862-ddfb-4359-8499-bd09553112ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ace8862-ddfb-4359-8499-bd09553112ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9740029a-ba8a-4cfc-b8f4-b16fe65bfd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9740029a-ba8a-4cfc-b8f4-b16fe65bfd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e42be479-3092-41fb-8a8d-8302f0a9461c', 'volume_name': 'volume-e42be479-3092-41fb-8a8d-8302f0a9461c', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c86073-98e1-4d34-afb5-16252aef1ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c86073-98e1-4d34-afb5-16252aef1ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89845fd1-7b83-41e0-bb67-88e28da1d662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:12 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Volume e42be479-3092-41fb-8a8d-8302f0a9461c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e42be479-3092-41fb-8a8d-8302f0a9461c', 'volume_size': 1} Jul 21 02:19:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:12 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8ea993fd-0079-4f14-812c-1045a05d5168" returned: 0 in 0.712s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:19:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.111s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-779656147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e905f7e-3754-45ed-8fb1-df4341d4a7e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='131539cd18c24f9f91bfa38c33e3cabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:19:10Z,use_quota=True,user_id='844a34fd8f64409db7cc2bc6f89c3322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:19:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Creating volume 7e905f7e-3754-45ed-8fb1-df4341d4a7e2 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:19:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:19:12 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:19:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7e905f7e-3754-45ed-8fb1-df4341d4a7e2 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42d0cc3f-200b-475d-84d2-045ddb8c1b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ea993fd-0079-4f14-812c-1045a05d5168', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923d2741-7bb6-4488-9389-dcb27ad51b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:12 devstack sudo[102932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7e905f7e-3754-45ed-8fb1-df4341d4a7e2 1073741824 Jul 21 02:19:12 devstack sudo[102932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:12 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Volume volume-8ea993fd-0079-4f14-812c-1045a05d5168 (8ea993fd-0079-4f14-812c-1045a05d5168): created successfully Jul 21 02:19:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923d2741-7bb6-4488-9389-dcb27ad51b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Flow 'volume_create_manager' (084e7b2a-89f0-4e53-8d1c-e5b2e84a4dcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:19:12 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-5e25aabb-4a46-46c4-8151-f774442dc2c6 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Created volume successfully. Jul 21 02:19:13 devstack sudo[102932]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7e905f7e-3754-45ed-8fb1-df4341d4a7e2 1073741824" returned: 0 in 0.629s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7e905f7e-3754-45ed-8fb1-df4341d4a7e2 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:13 devstack sudo[102938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7e905f7e-3754-45ed-8fb1-df4341d4a7e2 Jul 21 02:19:13 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:13 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7e905f7e-3754-45ed-8fb1-df4341d4a7e2" returned: 0 in 0.329s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:19:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.065s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1393119011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=face193e-2935-4a91-9000-9b89c1bc8ba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='131539cd18c24f9f91bfa38c33e3cabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:19:11Z,use_quota=True,user_id='844a34fd8f64409db7cc2bc6f89c3322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:19:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Creating volume face193e-2935-4a91-9000-9b89c1bc8ba9 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:19:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:19:13 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:19:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-face193e-2935-4a91-9000-9b89c1bc8ba9 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d716aa9c-c219-4fde-9aa4-731ad3e53c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e905f7e-3754-45ed-8fb1-df4341d4a7e2', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:13 devstack sudo[102941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-face193e-2935-4a91-9000-9b89c1bc8ba9 1073741824 Jul 21 02:19:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b806ff5-9246-438e-a5f4-06accd554ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:13 devstack sudo[102941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:13 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Volume volume-7e905f7e-3754-45ed-8fb1-df4341d4a7e2 (7e905f7e-3754-45ed-8fb1-df4341d4a7e2): created successfully Jul 21 02:19:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b806ff5-9246-438e-a5f4-06accd554ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Flow 'volume_create_manager' (9c12c2db-a966-4b3f-a0de-a94d18731193) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:19:14 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-a857fc8f-f81d-474f-a0b6-d245cd9ce548 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Created volume successfully. Jul 21 02:19:14 devstack sudo[102941]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-face193e-2935-4a91-9000-9b89c1bc8ba9 1073741824" returned: 0 in 0.712s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:14 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:19:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] Flow 'volume_create_manager' (ad11c488-ef7a-49e3-a1ca-f8f8c753500f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:19:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (261a6d4c-1cde-4e08-953e-6341195aef24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (261a6d4c-1cde-4e08-953e-6341195aef24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1277557482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0208e81-e303-451e-8c6b-771cb46727e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310cda3ac3c24853a93dbba6d5b1c784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:19:14Z,use_quota=True,user_id='071c497ebb7f4bcb9eb840ad5c8e2f85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb407d9c-710e-4461-aad1-d63a3e5fcdc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb407d9c-710e-4461-aad1-d63a3e5fcdc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5e7c2f-433c-4811-bf9d-a2f9a63c0c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5e7c2f-433c-4811-bf9d-a2f9a63c0c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0208e81-e303-451e-8c6b-771cb46727e9', 'volume_name': 'volume-d0208e81-e303-451e-8c6b-771cb46727e9', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (330841e7-4b22-4dc4-b689-ad96f4403b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (330841e7-4b22-4dc4-b689-ad96f4403b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60c5fba8-1916-4e29-a46a-6a58227fb748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:14 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] Volume d0208e81-e303-451e-8c6b-771cb46727e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0208e81-e303-451e-8c6b-771cb46727e9', 'volume_size': 1} Jul 21 02:19:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-face193e-2935-4a91-9000-9b89c1bc8ba9 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:14 devstack sudo[102946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-face193e-2935-4a91-9000-9b89c1bc8ba9 Jul 21 02:19:14 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:14 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-face193e-2935-4a91-9000-9b89c1bc8ba9" returned: 0 in 0.277s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.386s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1352526800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e42be479-3092-41fb-8a8d-8302f0a9461c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='131539cd18c24f9f91bfa38c33e3cabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:19:12Z,use_quota=True,user_id='844a34fd8f64409db7cc2bc6f89c3322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Creating volume e42be479-3092-41fb-8a8d-8302f0a9461c {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:19:15 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e42be479-3092-41fb-8a8d-8302f0a9461c 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d637f66d-c6e2-4b3e-a994-1e8281b04f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-face193e-2935-4a91-9000-9b89c1bc8ba9', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd40bfb2-3045-487e-ba53-2922ee654b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:15 devstack sudo[102949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e42be479-3092-41fb-8a8d-8302f0a9461c 1073741824 Jul 21 02:19:15 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:15 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Volume volume-face193e-2935-4a91-9000-9b89c1bc8ba9 (face193e-2935-4a91-9000-9b89c1bc8ba9): created successfully Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd40bfb2-3045-487e-ba53-2922ee654b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Flow 'volume_create_manager' (1a4a3078-51ac-4276-b7b2-8973f244d1d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:19:15 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-0ea89bf8-56d1-4d89-9555-51d9348a4382 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Created volume successfully. Jul 21 02:19:15 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e42be479-3092-41fb-8a8d-8302f0a9461c 1073741824" returned: 0 in 0.495s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e42be479-3092-41fb-8a8d-8302f0a9461c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:15 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e42be479-3092-41fb-8a8d-8302f0a9461c Jul 21 02:19:15 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:15 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e42be479-3092-41fb-8a8d-8302f0a9461c" returned: 0 in 0.326s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.182s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1277557482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0208e81-e303-451e-8c6b-771cb46727e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310cda3ac3c24853a93dbba6d5b1c784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:19:14Z,use_quota=True,user_id='071c497ebb7f4bcb9eb840ad5c8e2f85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] Creating volume d0208e81-e303-451e-8c6b-771cb46727e9 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:19:15 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d0208e81-e303-451e-8c6b-771cb46727e9 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89845fd1-7b83-41e0-bb67-88e28da1d662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e42be479-3092-41fb-8a8d-8302f0a9461c', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e7dc639-8514-4a5a-a7fa-a76e07e9b9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:15 devstack sudo[102958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d0208e81-e303-451e-8c6b-771cb46727e9 1073741824 Jul 21 02:19:15 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:15 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Volume volume-e42be479-3092-41fb-8a8d-8302f0a9461c (e42be479-3092-41fb-8a8d-8302f0a9461c): created successfully Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e7dc639-8514-4a5a-a7fa-a76e07e9b9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:15 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Flow 'volume_create_manager' (edb9cd06-4128-4762-99f1-314b651d23e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:19:15 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-b11fae42-fbec-4433-aa6f-7fe3208027d5 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Created volume successfully. Jul 21 02:19:16 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d0208e81-e303-451e-8c6b-771cb46727e9 1073741824" returned: 0 in 0.621s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d0208e81-e303-451e-8c6b-771cb46727e9 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:16 devstack sudo[102965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d0208e81-e303-451e-8c6b-771cb46727e9 Jul 21 02:19:16 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:16 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d0208e81-e303-451e-8c6b-771cb46727e9" returned: 0 in 0.261s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:16 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:19:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:16 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60c5fba8-1916-4e29-a46a-6a58227fb748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0208e81-e303-451e-8c6b-771cb46727e9', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:16 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10783103-67c9-4521-843a-6aa7cdbd3e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:16 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] Volume volume-d0208e81-e303-451e-8c6b-771cb46727e9 (d0208e81-e303-451e-8c6b-771cb46727e9): created successfully Jul 21 02:19:16 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10783103-67c9-4521-843a-6aa7cdbd3e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:16 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] Flow 'volume_create_manager' (ad11c488-ef7a-49e3-a1ca-f8f8c753500f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:19:16 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-f17061cd-c50a-49d0-80be-870d7441842b tempest-ProjectReaderTests-1745342077 None] Created volume successfully. Jul 21 02:19:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-24064a9e-b1c9-4504-93ad-e875632bd0db tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "cinder-e42be479-3092-41fb-8a8d-8302f0a9461c-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-24064a9e-b1c9-4504-93ad-e875632bd0db tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "cinder-e42be479-3092-41fb-8a8d-8302f0a9461c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-24064a9e-b1c9-4504-93ad-e875632bd0db tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "cinder-quobyte-e42be479-3092-41fb-8a8d-8302f0a9461c" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-24064a9e-b1c9-4504-93ad-e875632bd0db tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "cinder-quobyte-e42be479-3092-41fb-8a8d-8302f0a9461c" acquired by "delete_volume" :: waited 0.016s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:17 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea27e15f-b586-47e0-92d6-28cd0091b870]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:19:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-24064a9e-b1c9-4504-93ad-e875632bd0db tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e42be479-3092-41fb-8a8d-8302f0a9461c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:17 devstack sudo[102968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e42be479-3092-41fb-8a8d-8302f0a9461c Jul 21 02:19:17 devstack sudo[102968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:17 devstack sudo[102968]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-24064a9e-b1c9-4504-93ad-e875632bd0db tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e42be479-3092-41fb-8a8d-8302f0a9461c" returned: 0 in 0.359s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-24064a9e-b1c9-4504-93ad-e875632bd0db tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e42be479-3092-41fb-8a8d-8302f0a9461c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:17 devstack sudo[102973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e42be479-3092-41fb-8a8d-8302f0a9461c Jul 21 02:19:17 devstack sudo[102973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:17 devstack sudo[102973]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-24064a9e-b1c9-4504-93ad-e875632bd0db tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e42be479-3092-41fb-8a8d-8302f0a9461c" returned: 0 in 0.268s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-24064a9e-b1c9-4504-93ad-e875632bd0db tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "cinder-quobyte-e42be479-3092-41fb-8a8d-8302f0a9461c" released by "delete_volume" :: held 0.675s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-50c717f6-d674-4a65-a82f-0d53fe42b62f tempest-ProjectReaderTests-1745342077 None] Acquiring lock "cinder-d0208e81-e303-451e-8c6b-771cb46727e9-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-50c717f6-d674-4a65-a82f-0d53fe42b62f tempest-ProjectReaderTests-1745342077 None] Lock "cinder-d0208e81-e303-451e-8c6b-771cb46727e9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:17 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-24064a9e-b1c9-4504-93ad-e875632bd0db tempest-CreateVolumesFromSnapshotTest-1909230096 None] Created reservations ['12e036fd-db51-44eb-a617-1b31124c3cc8', 'd4d07fb7-442d-4005-8167-d53fcc6b65fe', '7137d661-fbef-4a2c-9e70-edd4a6102ae0', 'cb67160c-1ed0-4b23-8ce4-306d0c2f1bf2'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:19:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-50c717f6-d674-4a65-a82f-0d53fe42b62f tempest-ProjectReaderTests-1745342077 None] Acquiring lock "cinder-quobyte-d0208e81-e303-451e-8c6b-771cb46727e9" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-50c717f6-d674-4a65-a82f-0d53fe42b62f tempest-ProjectReaderTests-1745342077 None] Lock "cinder-quobyte-d0208e81-e303-451e-8c6b-771cb46727e9" acquired by "delete_volume" :: waited 0.029s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:18 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b183538-e68e-4857-ae6d-5848c9455c66]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:19:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-50c717f6-d674-4a65-a82f-0d53fe42b62f tempest-ProjectReaderTests-1745342077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d0208e81-e303-451e-8c6b-771cb46727e9 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-24064a9e-b1c9-4504-93ad-e875632bd0db tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-24064a9e-b1c9-4504-93ad-e875632bd0db tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-24064a9e-b1c9-4504-93ad-e875632bd0db tempest-CreateVolumesFromSnapshotTest-1909230096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-24064a9e-b1c9-4504-93ad-e875632bd0db tempest-CreateVolumesFromSnapshotTest-1909230096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-24064a9e-b1c9-4504-93ad-e875632bd0db tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-24064a9e-b1c9-4504-93ad-e875632bd0db tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:18 devstack sudo[102979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:19:18 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:18 devstack sudo[102977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d0208e81-e303-451e-8c6b-771cb46727e9 Jul 21 02:19:18 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3774a1b6-f189-4147-b710-7c418d1cc56c tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "cinder-face193e-2935-4a91-9000-9b89c1bc8ba9-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3774a1b6-f189-4147-b710-7c418d1cc56c tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "cinder-face193e-2935-4a91-9000-9b89c1bc8ba9-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3774a1b6-f189-4147-b710-7c418d1cc56c tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "cinder-quobyte-face193e-2935-4a91-9000-9b89c1bc8ba9" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3774a1b6-f189-4147-b710-7c418d1cc56c tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "cinder-quobyte-face193e-2935-4a91-9000-9b89c1bc8ba9" acquired by "delete_volume" :: waited 0.028s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:18 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0235a40-4deb-49ac-867e-1ed14838ea44]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:19:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3774a1b6-f189-4147-b710-7c418d1cc56c tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-face193e-2935-4a91-9000-9b89c1bc8ba9 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:18 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-24064a9e-b1c9-4504-93ad-e875632bd0db tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.432s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:18 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-24064a9e-b1c9-4504-93ad-e875632bd0db tempest-CreateVolumesFromSnapshotTest-1909230096 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:19:18 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-24064a9e-b1c9-4504-93ad-e875632bd0db tempest-CreateVolumesFromSnapshotTest-1909230096 None] Deleted volume successfully. Jul 21 02:19:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-24064a9e-b1c9-4504-93ad-e875632bd0db tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "cinder-e42be479-3092-41fb-8a8d-8302f0a9461c-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:18 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-50c717f6-d674-4a65-a82f-0d53fe42b62f tempest-ProjectReaderTests-1745342077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d0208e81-e303-451e-8c6b-771cb46727e9" returned: 0 in 0.584s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-50c717f6-d674-4a65-a82f-0d53fe42b62f tempest-ProjectReaderTests-1745342077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d0208e81-e303-451e-8c6b-771cb46727e9 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:18 devstack sudo[102987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d0208e81-e303-451e-8c6b-771cb46727e9 Jul 21 02:19:18 devstack sudo[102987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:18 devstack sudo[102983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-face193e-2935-4a91-9000-9b89c1bc8ba9 Jul 21 02:19:18 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:18 devstack sudo[102987]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-50c717f6-d674-4a65-a82f-0d53fe42b62f tempest-ProjectReaderTests-1745342077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d0208e81-e303-451e-8c6b-771cb46727e9" returned: 0 in 0.285s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-50c717f6-d674-4a65-a82f-0d53fe42b62f tempest-ProjectReaderTests-1745342077 None] Lock "cinder-quobyte-d0208e81-e303-451e-8c6b-771cb46727e9" released by "delete_volume" :: held 0.926s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:18 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3774a1b6-f189-4147-b710-7c418d1cc56c tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-face193e-2935-4a91-9000-9b89c1bc8ba9" returned: 0 in 0.466s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3774a1b6-f189-4147-b710-7c418d1cc56c tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-face193e-2935-4a91-9000-9b89c1bc8ba9 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:19 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-face193e-2935-4a91-9000-9b89c1bc8ba9 Jul 21 02:19:19 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:19 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-50c717f6-d674-4a65-a82f-0d53fe42b62f tempest-ProjectReaderTests-1745342077 None] Created reservations ['21f24e65-0f67-4dc7-88cd-0879f1d46f39', 'a6d13f5d-588f-41b7-8251-3ba8382c0e10', '0a8f7c36-f503-4e77-83f2-12af59111d1f', 'f1b14e9c-4b6f-4816-aa7d-fccf9055bcde'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:19:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-50c717f6-d674-4a65-a82f-0d53fe42b62f tempest-ProjectReaderTests-1745342077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-50c717f6-d674-4a65-a82f-0d53fe42b62f tempest-ProjectReaderTests-1745342077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:19 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-50c717f6-d674-4a65-a82f-0d53fe42b62f tempest-ProjectReaderTests-1745342077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:19 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-50c717f6-d674-4a65-a82f-0d53fe42b62f tempest-ProjectReaderTests-1745342077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-50c717f6-d674-4a65-a82f-0d53fe42b62f tempest-ProjectReaderTests-1745342077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-50c717f6-d674-4a65-a82f-0d53fe42b62f tempest-ProjectReaderTests-1745342077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:19 devstack sudo[102996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:19:19 devstack sudo[102996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:19 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3774a1b6-f189-4147-b710-7c418d1cc56c tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-face193e-2935-4a91-9000-9b89c1bc8ba9" returned: 0 in 0.326s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:19 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3774a1b6-f189-4147-b710-7c418d1cc56c tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "cinder-quobyte-face193e-2935-4a91-9000-9b89c1bc8ba9" released by "delete_volume" :: held 0.845s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:19 devstack sudo[102996]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:19 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-3774a1b6-f189-4147-b710-7c418d1cc56c tempest-CreateVolumesFromSnapshotTest-1909230096 None] Created reservations ['694449bf-f2c1-40bb-bf8b-31f5a1fcf231', 'cac58a6c-9475-433a-aac5-a23089aa4677', 'd940e21b-a3c5-4b89-9fac-3d25f9dac2eb', '3e096ea4-7d2c-45ca-8b24-1cdc4dcd8820'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:19:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-50c717f6-d674-4a65-a82f-0d53fe42b62f tempest-ProjectReaderTests-1745342077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.290s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:19 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-50c717f6-d674-4a65-a82f-0d53fe42b62f tempest-ProjectReaderTests-1745342077 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:19:19 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-50c717f6-d674-4a65-a82f-0d53fe42b62f tempest-ProjectReaderTests-1745342077 None] Deleted volume successfully. Jul 21 02:19:19 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-50c717f6-d674-4a65-a82f-0d53fe42b62f tempest-ProjectReaderTests-1745342077 None] Lock "cinder-d0208e81-e303-451e-8c6b-771cb46727e9-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3774a1b6-f189-4147-b710-7c418d1cc56c tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3774a1b6-f189-4147-b710-7c418d1cc56c tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:19 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-3774a1b6-f189-4147-b710-7c418d1cc56c tempest-CreateVolumesFromSnapshotTest-1909230096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:19 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-3774a1b6-f189-4147-b710-7c418d1cc56c tempest-CreateVolumesFromSnapshotTest-1909230096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3774a1b6-f189-4147-b710-7c418d1cc56c tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3774a1b6-f189-4147-b710-7c418d1cc56c tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:19 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:19:19 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:19 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e37b9ff7-aa42-47d6-9b6a-50f9f0af916e tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "cinder-7e905f7e-3754-45ed-8fb1-df4341d4a7e2-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:19 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e37b9ff7-aa42-47d6-9b6a-50f9f0af916e tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "cinder-7e905f7e-3754-45ed-8fb1-df4341d4a7e2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:19 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e37b9ff7-aa42-47d6-9b6a-50f9f0af916e tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "cinder-quobyte-7e905f7e-3754-45ed-8fb1-df4341d4a7e2" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:19 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e37b9ff7-aa42-47d6-9b6a-50f9f0af916e tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "cinder-quobyte-7e905f7e-3754-45ed-8fb1-df4341d4a7e2" acquired by "delete_volume" :: waited 0.020s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:19 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ee553d-6cab-41b9-b533-eb262aaa5aba]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:19:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e37b9ff7-aa42-47d6-9b6a-50f9f0af916e tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7e905f7e-3754-45ed-8fb1-df4341d4a7e2 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:19 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3774a1b6-f189-4147-b710-7c418d1cc56c tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.361s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:19 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-3774a1b6-f189-4147-b710-7c418d1cc56c tempest-CreateVolumesFromSnapshotTest-1909230096 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:19:19 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-3774a1b6-f189-4147-b710-7c418d1cc56c tempest-CreateVolumesFromSnapshotTest-1909230096 None] Deleted volume successfully. Jul 21 02:19:19 devstack sudo[103002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7e905f7e-3754-45ed-8fb1-df4341d4a7e2 Jul 21 02:19:19 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:19 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3774a1b6-f189-4147-b710-7c418d1cc56c tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "cinder-face193e-2935-4a91-9000-9b89c1bc8ba9-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:20 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e37b9ff7-aa42-47d6-9b6a-50f9f0af916e tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7e905f7e-3754-45ed-8fb1-df4341d4a7e2" returned: 0 in 0.397s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e37b9ff7-aa42-47d6-9b6a-50f9f0af916e tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7e905f7e-3754-45ed-8fb1-df4341d4a7e2 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:20 devstack sudo[103008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7e905f7e-3754-45ed-8fb1-df4341d4a7e2 Jul 21 02:19:20 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:20 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e37b9ff7-aa42-47d6-9b6a-50f9f0af916e tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7e905f7e-3754-45ed-8fb1-df4341d4a7e2" returned: 0 in 0.277s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e37b9ff7-aa42-47d6-9b6a-50f9f0af916e tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "cinder-quobyte-7e905f7e-3754-45ed-8fb1-df4341d4a7e2" released by "delete_volume" :: held 0.729s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-e37b9ff7-aa42-47d6-9b6a-50f9f0af916e tempest-CreateVolumesFromSnapshotTest-1909230096 None] Created reservations ['708086a0-633f-4497-b79f-886764845ce1', '2fca6142-14e2-4fc2-9f54-6868ec4ffa75', '0f9329f8-7c18-4030-b962-8a394be6827e', '0f54815b-cc79-4f42-9fa5-89d6bce3dc18'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e37b9ff7-aa42-47d6-9b6a-50f9f0af916e tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e37b9ff7-aa42-47d6-9b6a-50f9f0af916e tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e37b9ff7-aa42-47d6-9b6a-50f9f0af916e tempest-CreateVolumesFromSnapshotTest-1909230096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e37b9ff7-aa42-47d6-9b6a-50f9f0af916e tempest-CreateVolumesFromSnapshotTest-1909230096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e37b9ff7-aa42-47d6-9b6a-50f9f0af916e tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e37b9ff7-aa42-47d6-9b6a-50f9f0af916e tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:20 devstack sudo[103011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:19:20 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] Flow 'volume_create_manager' (d7dd7e64-ec0b-48fc-b480-0e70ef0b7835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4095298-2651-4161-be06-7ab20425250e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4095298-2651-4161-be06-7ab20425250e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1147898493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=370e60c4-c959-4726-a599-0c0b23222c4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310cda3ac3c24853a93dbba6d5b1c784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:19:21Z,use_quota=True,user_id='071c497ebb7f4bcb9eb840ad5c8e2f85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15abbde2-3a54-4b9b-89af-0b4a2c202b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15abbde2-3a54-4b9b-89af-0b4a2c202b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (540c5feb-b8ac-4eb4-8879-19684b18059f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (540c5feb-b8ac-4eb4-8879-19684b18059f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '370e60c4-c959-4726-a599-0c0b23222c4e', 'volume_name': 'volume-370e60c4-c959-4726-a599-0c0b23222c4e', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615fdc29-72df-4573-a054-46a8b2466de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615fdc29-72df-4573-a054-46a8b2466de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f67c39cc-acea-4381-ace3-b5e52e5dbbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:20 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] Volume 370e60c4-c959-4726-a599-0c0b23222c4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-370e60c4-c959-4726-a599-0c0b23222c4e', 'volume_size': 1} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1147898493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=370e60c4-c959-4726-a599-0c0b23222c4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310cda3ac3c24853a93dbba6d5b1c784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:19:21Z,use_quota=True,user_id='071c497ebb7f4bcb9eb840ad5c8e2f85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] Creating volume 370e60c4-c959-4726-a599-0c0b23222c4e {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:19:20 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-370e60c4-c959-4726-a599-0c0b23222c4e 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:20 devstack sudo[103014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-370e60c4-c959-4726-a599-0c0b23222c4e 1073741824 Jul 21 02:19:20 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a5b729ca-bd3b-40e3-9443-a0399d27a781 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "cinder-8ea993fd-0079-4f14-812c-1045a05d5168-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a5b729ca-bd3b-40e3-9443-a0399d27a781 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "cinder-8ea993fd-0079-4f14-812c-1045a05d5168-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a5b729ca-bd3b-40e3-9443-a0399d27a781 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "cinder-quobyte-8ea993fd-0079-4f14-812c-1045a05d5168" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a5b729ca-bd3b-40e3-9443-a0399d27a781 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "cinder-quobyte-8ea993fd-0079-4f14-812c-1045a05d5168" acquired by "delete_volume" :: waited 0.018s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07809c7-785d-4a04-ac51-e4633247eee3]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a5b729ca-bd3b-40e3-9443-a0399d27a781 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8ea993fd-0079-4f14-812c-1045a05d5168 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:20 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e37b9ff7-aa42-47d6-9b6a-50f9f0af916e tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.381s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:20 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-e37b9ff7-aa42-47d6-9b6a-50f9f0af916e tempest-CreateVolumesFromSnapshotTest-1909230096 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:19:20 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-e37b9ff7-aa42-47d6-9b6a-50f9f0af916e tempest-CreateVolumesFromSnapshotTest-1909230096 None] Deleted volume successfully. Jul 21 02:19:21 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e37b9ff7-aa42-47d6-9b6a-50f9f0af916e tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "cinder-7e905f7e-3754-45ed-8fb1-df4341d4a7e2-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:21 devstack sudo[103017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8ea993fd-0079-4f14-812c-1045a05d5168 Jul 21 02:19:21 devstack sudo[103017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:21 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-370e60c4-c959-4726-a599-0c0b23222c4e 1073741824" returned: 0 in 0.545s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-370e60c4-c959-4726-a599-0c0b23222c4e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:21 devstack sudo[103017]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a5b729ca-bd3b-40e3-9443-a0399d27a781 tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8ea993fd-0079-4f14-812c-1045a05d5168" returned: 0 in 0.434s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a5b729ca-bd3b-40e3-9443-a0399d27a781 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8ea993fd-0079-4f14-812c-1045a05d5168 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:21 devstack sudo[103028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-370e60c4-c959-4726-a599-0c0b23222c4e Jul 21 02:19:21 devstack sudo[103028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:21 devstack sudo[103029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8ea993fd-0079-4f14-812c-1045a05d5168 Jul 21 02:19:21 devstack sudo[103029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:21 devstack sudo[103028]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-370e60c4-c959-4726-a599-0c0b23222c4e" returned: 0 in 0.259s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:21 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:19:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:21 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f67c39cc-acea-4381-ace3-b5e52e5dbbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-370e60c4-c959-4726-a599-0c0b23222c4e', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:21 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50d6663b-3840-41b4-99a1-18658ec422e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:21 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] Volume volume-370e60c4-c959-4726-a599-0c0b23222c4e (370e60c4-c959-4726-a599-0c0b23222c4e): created successfully Jul 21 02:19:21 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50d6663b-3840-41b4-99a1-18658ec422e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:21 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] Flow 'volume_create_manager' (d7dd7e64-ec0b-48fc-b480-0e70ef0b7835) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:19:21 devstack sudo[103029]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a5b729ca-bd3b-40e3-9443-a0399d27a781 tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8ea993fd-0079-4f14-812c-1045a05d5168" returned: 0 in 0.313s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:21 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-e9d825dd-858e-41da-a42d-77fee70a48e6 tempest-ProjectReaderTests-1745342077 None] Created volume successfully. Jul 21 02:19:21 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a5b729ca-bd3b-40e3-9443-a0399d27a781 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "cinder-quobyte-8ea993fd-0079-4f14-812c-1045a05d5168" released by "delete_volume" :: held 0.792s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:21 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-a5b729ca-bd3b-40e3-9443-a0399d27a781 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Created reservations ['00634592-e7c1-41fd-bbd3-bfa043c6a2e8', '49df8e52-98ae-4beb-b1ab-aafdeb1e9c79', '7d3c9214-5b77-4bf0-ae66-fa6896969959', 'dd2fd6c0-3601-4bff-8059-02bedbb41838'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:19:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a5b729ca-bd3b-40e3-9443-a0399d27a781 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a5b729ca-bd3b-40e3-9443-a0399d27a781 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:21 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-a5b729ca-bd3b-40e3-9443-a0399d27a781 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:21 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-a5b729ca-bd3b-40e3-9443-a0399d27a781 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a5b729ca-bd3b-40e3-9443-a0399d27a781 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a5b729ca-bd3b-40e3-9443-a0399d27a781 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:21 devstack sudo[103037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:19:21 devstack sudo[103037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a780fb38-2b2b-4f80-a8a0-76f15a777b86 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "cinder-b34f25d8-0827-4801-a71b-f4b2199dd3f9-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a780fb38-2b2b-4f80-a8a0-76f15a777b86 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "cinder-b34f25d8-0827-4801-a71b-f4b2199dd3f9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a780fb38-2b2b-4f80-a8a0-76f15a777b86 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "cinder-quobyte-b34f25d8-0827-4801-a71b-f4b2199dd3f9" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a780fb38-2b2b-4f80-a8a0-76f15a777b86 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "cinder-quobyte-b34f25d8-0827-4801-a71b-f4b2199dd3f9" acquired by "delete_volume" :: waited 0.017s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:22 devstack sudo[103037]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a5b729ca-bd3b-40e3-9443-a0399d27a781 tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.261s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:22 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-a5b729ca-bd3b-40e3-9443-a0399d27a781 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:19:22 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-a5b729ca-bd3b-40e3-9443-a0399d27a781 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Deleted volume successfully. Jul 21 02:19:22 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[237a433f-3a8d-4831-bd82-4925d06b9539]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:19:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a780fb38-2b2b-4f80-a8a0-76f15a777b86 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b34f25d8-0827-4801-a71b-f4b2199dd3f9 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a5b729ca-bd3b-40e3-9443-a0399d27a781 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "cinder-8ea993fd-0079-4f14-812c-1045a05d5168-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:22 devstack sudo[103040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b34f25d8-0827-4801-a71b-f4b2199dd3f9 Jul 21 02:19:22 devstack sudo[103040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:22 devstack sudo[103040]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a780fb38-2b2b-4f80-a8a0-76f15a777b86 tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b34f25d8-0827-4801-a71b-f4b2199dd3f9" returned: 0 in 0.399s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a780fb38-2b2b-4f80-a8a0-76f15a777b86 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b34f25d8-0827-4801-a71b-f4b2199dd3f9 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:22 devstack sudo[103045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b34f25d8-0827-4801-a71b-f4b2199dd3f9 Jul 21 02:19:22 devstack sudo[103045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-adec52b8-48ab-4e6f-af10-13903f9391ba tempest-ProjectReaderTests-1745342077 None] Acquiring lock "cinder-370e60c4-c959-4726-a599-0c0b23222c4e-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-adec52b8-48ab-4e6f-af10-13903f9391ba tempest-ProjectReaderTests-1745342077 None] Lock "cinder-370e60c4-c959-4726-a599-0c0b23222c4e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:22 devstack sudo[103045]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a780fb38-2b2b-4f80-a8a0-76f15a777b86 tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b34f25d8-0827-4801-a71b-f4b2199dd3f9" returned: 0 in 0.310s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-adec52b8-48ab-4e6f-af10-13903f9391ba tempest-ProjectReaderTests-1745342077 None] Acquiring lock "cinder-quobyte-370e60c4-c959-4726-a599-0c0b23222c4e" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a780fb38-2b2b-4f80-a8a0-76f15a777b86 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "cinder-quobyte-b34f25d8-0827-4801-a71b-f4b2199dd3f9" released by "delete_volume" :: held 0.775s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-adec52b8-48ab-4e6f-af10-13903f9391ba tempest-ProjectReaderTests-1745342077 None] Lock "cinder-quobyte-370e60c4-c959-4726-a599-0c0b23222c4e" acquired by "delete_volume" :: waited 0.020s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:22 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7f2d7d-ce29-4654-95cc-4b8f16da5948]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:19:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-adec52b8-48ab-4e6f-af10-13903f9391ba tempest-ProjectReaderTests-1745342077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-370e60c4-c959-4726-a599-0c0b23222c4e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:22 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-a780fb38-2b2b-4f80-a8a0-76f15a777b86 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Created reservations ['6fd3c1c6-2d69-4400-bbe5-e713c0a84802', 'aaf62295-2988-42e4-803a-4447e13e53fa', 'c242d13f-24fc-4a48-8094-4d26856abd47', '8c9a5262-4b38-4b7c-a3ae-34f297ae66f3'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a780fb38-2b2b-4f80-a8a0-76f15a777b86 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a780fb38-2b2b-4f80-a8a0-76f15a777b86 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-a780fb38-2b2b-4f80-a8a0-76f15a777b86 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-a780fb38-2b2b-4f80-a8a0-76f15a777b86 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a780fb38-2b2b-4f80-a8a0-76f15a777b86 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a780fb38-2b2b-4f80-a8a0-76f15a777b86 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:23 devstack sudo[103060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-370e60c4-c959-4726-a599-0c0b23222c4e Jul 21 02:19:23 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:23 devstack sudo[103061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:19:23 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-23a1947e-c7dc-451d-b33d-5f122c30c561 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "cinder-056899d7-dc9d-4a89-aaa4-11fe32fb64ed-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-23a1947e-c7dc-451d-b33d-5f122c30c561 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "cinder-056899d7-dc9d-4a89-aaa4-11fe32fb64ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-23a1947e-c7dc-451d-b33d-5f122c30c561 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "cinder-quobyte-1f33aee5-7899-4d49-8443-c98ae237bde2" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-23a1947e-c7dc-451d-b33d-5f122c30c561 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "cinder-quobyte-1f33aee5-7899-4d49-8443-c98ae237bde2" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-23a1947e-c7dc-451d-b33d-5f122c30c561 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "cinder-quobyte-056899d7-dc9d-4a89-aaa4-11fe32fb64ed" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-23a1947e-c7dc-451d-b33d-5f122c30c561 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "cinder-quobyte-056899d7-dc9d-4a89-aaa4-11fe32fb64ed" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-23a1947e-c7dc-451d-b33d-5f122c30c561 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Deleting offline snapshot 056899d7-dc9d-4a89-aaa4-11fe32fb64ed of volume 1f33aee5-7899-4d49-8443-c98ae237bde2 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-23a1947e-c7dc-451d-b33d-5f122c30c561 tempest-CreateVolumesFromSnapshotTest-1909230096 None] snapshot_file for this snap is: volume-1f33aee5-7899-4d49-8443-c98ae237bde2.056899d7-dc9d-4a89-aaa4-11fe32fb64ed {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[acaa9ee3-fd53-4480-9f32-f33c0ab34f38]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-23a1947e-c7dc-451d-b33d-5f122c30c561 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2.056899d7-dc9d-4a89-aaa4-11fe32fb64ed {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:23 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:23 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-adec52b8-48ab-4e6f-af10-13903f9391ba tempest-ProjectReaderTests-1745342077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-370e60c4-c959-4726-a599-0c0b23222c4e" returned: 0 in 0.456s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a780fb38-2b2b-4f80-a8a0-76f15a777b86 tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.350s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-adec52b8-48ab-4e6f-af10-13903f9391ba tempest-ProjectReaderTests-1745342077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-370e60c4-c959-4726-a599-0c0b23222c4e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-a780fb38-2b2b-4f80-a8a0-76f15a777b86 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:19:23 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-a780fb38-2b2b-4f80-a8a0-76f15a777b86 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Deleted volume successfully. Jul 21 02:19:23 devstack sudo[103070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-370e60c4-c959-4726-a599-0c0b23222c4e Jul 21 02:19:23 devstack sudo[103070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a780fb38-2b2b-4f80-a8a0-76f15a777b86 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "cinder-b34f25d8-0827-4801-a71b-f4b2199dd3f9-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:23 devstack sudo[103069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2.056899d7-dc9d-4a89-aaa4-11fe32fb64ed Jul 21 02:19:23 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:23 devstack sudo[103070]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-adec52b8-48ab-4e6f-af10-13903f9391ba tempest-ProjectReaderTests-1745342077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-370e60c4-c959-4726-a599-0c0b23222c4e" returned: 0 in 0.265s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-adec52b8-48ab-4e6f-af10-13903f9391ba tempest-ProjectReaderTests-1745342077 None] Lock "cinder-quobyte-370e60c4-c959-4726-a599-0c0b23222c4e" released by "delete_volume" :: held 0.766s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-adec52b8-48ab-4e6f-af10-13903f9391ba tempest-ProjectReaderTests-1745342077 None] Created reservations ['dce531e0-25e6-45f2-9a74-65455a51bb77', 'ce398e3e-f015-4041-8d48-20ea91e5db69', '6c6a2ad1-aecd-4601-ae99-d9cdcb423c79', '0b3f34b7-25b7-4519-aaf5-3e3494efb211'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:19:23 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-23a1947e-c7dc-451d-b33d-5f122c30c561 tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2.056899d7-dc9d-4a89-aaa4-11fe32fb64ed" returned: 0 in 0.373s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-23a1947e-c7dc-451d-b33d-5f122c30c561 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f33aee5-7899-4d49-8443-c98ae237bde2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[9453da2a-8805-4c2e-8db7-c4db700a4401]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-23a1947e-c7dc-451d-b33d-5f122c30c561 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-adec52b8-48ab-4e6f-af10-13903f9391ba tempest-ProjectReaderTests-1745342077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-adec52b8-48ab-4e6f-af10-13903f9391ba tempest-ProjectReaderTests-1745342077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-adec52b8-48ab-4e6f-af10-13903f9391ba tempest-ProjectReaderTests-1745342077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-adec52b8-48ab-4e6f-af10-13903f9391ba tempest-ProjectReaderTests-1745342077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-adec52b8-48ab-4e6f-af10-13903f9391ba tempest-ProjectReaderTests-1745342077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-adec52b8-48ab-4e6f-af10-13903f9391ba tempest-ProjectReaderTests-1745342077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:23 devstack sudo[103103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:19:23 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:23 devstack sudo[103102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2 Jul 21 02:19:23 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:24 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-adec52b8-48ab-4e6f-af10-13903f9391ba tempest-ProjectReaderTests-1745342077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.262s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:24 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-adec52b8-48ab-4e6f-af10-13903f9391ba tempest-ProjectReaderTests-1745342077 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:19:24 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-adec52b8-48ab-4e6f-af10-13903f9391ba tempest-ProjectReaderTests-1745342077 None] Deleted volume successfully. Jul 21 02:19:24 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-adec52b8-48ab-4e6f-af10-13903f9391ba tempest-ProjectReaderTests-1745342077 None] Lock "cinder-370e60c4-c959-4726-a599-0c0b23222c4e-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:24 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-23a1947e-c7dc-451d-b33d-5f122c30c561 tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2" returned: 0 in 0.399s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-23a1947e-c7dc-451d-b33d-5f122c30c561 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2.056899d7-dc9d-4a89-aaa4-11fe32fb64ed {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:24 devstack sudo[103110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2.056899d7-dc9d-4a89-aaa4-11fe32fb64ed Jul 21 02:19:24 devstack sudo[103110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:24 devstack sudo[103110]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-23a1947e-c7dc-451d-b33d-5f122c30c561 tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2.056899d7-dc9d-4a89-aaa4-11fe32fb64ed" returned: 0 in 0.346s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-23a1947e-c7dc-451d-b33d-5f122c30c561 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2.056899d7-dc9d-4a89-aaa4-11fe32fb64ed {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:24 devstack sudo[103115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2.056899d7-dc9d-4a89-aaa4-11fe32fb64ed Jul 21 02:19:24 devstack sudo[103115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:24 devstack sudo[103115]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-23a1947e-c7dc-451d-b33d-5f122c30c561 tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2.056899d7-dc9d-4a89-aaa4-11fe32fb64ed" returned: 0 in 0.263s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:24 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-23a1947e-c7dc-451d-b33d-5f122c30c561 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "cinder-quobyte-056899d7-dc9d-4a89-aaa4-11fe32fb64ed" released by "_delete_snapshot" :: held 1.505s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:24 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-23a1947e-c7dc-451d-b33d-5f122c30c561 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "cinder-quobyte-1f33aee5-7899-4d49-8443-c98ae237bde2" released by "delete_snapshot" :: held 1.538s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:24 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-23a1947e-c7dc-451d-b33d-5f122c30c561 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Created reservations ['fe6ef8cb-0cca-44a4-a70c-9f21ebd771df', '98728479-9802-4006-832b-71c690631d6e', 'acd0695c-aa68-428b-aad3-39aeabd5f18d', 'a5eb27c6-e393-4747-a0ac-eddb61fa1c95'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:19:24 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-23a1947e-c7dc-451d-b33d-5f122c30c561 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Delete snapshot completed successfully. Jul 21 02:19:24 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-23a1947e-c7dc-451d-b33d-5f122c30c561 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "cinder-056899d7-dc9d-4a89-aaa4-11fe32fb64ed-delete_snapshot" released by "delete_snapshot" :: held 1.703s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:25 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b4c827e7-ba34-4576-a440-85c224893921 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "cinder-1f33aee5-7899-4d49-8443-c98ae237bde2-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:25 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b4c827e7-ba34-4576-a440-85c224893921 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "cinder-1f33aee5-7899-4d49-8443-c98ae237bde2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:25 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b4c827e7-ba34-4576-a440-85c224893921 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "cinder-quobyte-1f33aee5-7899-4d49-8443-c98ae237bde2" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:25 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b4c827e7-ba34-4576-a440-85c224893921 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "cinder-quobyte-1f33aee5-7899-4d49-8443-c98ae237bde2" acquired by "delete_volume" :: waited 0.018s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:25 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4379e1-9ccf-4611-a29a-f2fff3ed893b]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:19:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b4c827e7-ba34-4576-a440-85c224893921 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:25 devstack sudo[103118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2 Jul 21 02:19:25 devstack sudo[103118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:25 devstack sudo[103118]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b4c827e7-ba34-4576-a440-85c224893921 tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2" returned: 0 in 0.371s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b4c827e7-ba34-4576-a440-85c224893921 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:25 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2 Jul 21 02:19:25 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:26 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b4c827e7-ba34-4576-a440-85c224893921 tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1f33aee5-7899-4d49-8443-c98ae237bde2" returned: 0 in 0.252s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:26 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b4c827e7-ba34-4576-a440-85c224893921 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "cinder-quobyte-1f33aee5-7899-4d49-8443-c98ae237bde2" released by "delete_volume" :: held 0.684s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:26 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-b4c827e7-ba34-4576-a440-85c224893921 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Created reservations ['d736c900-f1fd-405f-8b10-955402219669', '94739857-4adb-4068-8362-6d4209ba04f5', 'cd69330c-404e-46f3-a16a-eabdb494cdf8', 'd38e0ec6-81ea-426a-9208-19051acdaaa0'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:19:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b4c827e7-ba34-4576-a440-85c224893921 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b4c827e7-ba34-4576-a440-85c224893921 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:26 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b4c827e7-ba34-4576-a440-85c224893921 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:26 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b4c827e7-ba34-4576-a440-85c224893921 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b4c827e7-ba34-4576-a440-85c224893921 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b4c827e7-ba34-4576-a440-85c224893921 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:26 devstack sudo[103126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:19:26 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:26 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b4c827e7-ba34-4576-a440-85c224893921 tempest-CreateVolumesFromSnapshotTest-1909230096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.260s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:26 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-b4c827e7-ba34-4576-a440-85c224893921 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:19:26 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-b4c827e7-ba34-4576-a440-85c224893921 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Deleted volume successfully. Jul 21 02:19:26 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b4c827e7-ba34-4576-a440-85c224893921 tempest-CreateVolumesFromSnapshotTest-1909230096 None] Lock "cinder-1f33aee5-7899-4d49-8443-c98ae237bde2-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:29 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:19:29 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] Flow 'volume_create_manager' (b2433f28-050a-45bf-a054-a0ac9078d3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:19:29 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c953ced-b805-4dbe-9bbd-40d2bb1ff810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:29 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c953ced-b805-4dbe-9bbd-40d2bb1ff810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-396161370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13b34923-9a08-4d68-95c7-de8de99bdb57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40987ee8716d4814a159da93357d0724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:19:30Z,use_quota=True,user_id='3c21d4bde095491c9913ef94aa82cfb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:29 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d5d0bc-b035-4046-8390-2aea547eb58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:29 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d5d0bc-b035-4046-8390-2aea547eb58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:29 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d87b81bb-21ad-4533-91d6-8c4afd8b31f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:29 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d87b81bb-21ad-4533-91d6-8c4afd8b31f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13b34923-9a08-4d68-95c7-de8de99bdb57', 'volume_name': 'volume-13b34923-9a08-4d68-95c7-de8de99bdb57', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:29 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41bd7855-286d-4a59-8bd9-928f1ff470e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:29 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41bd7855-286d-4a59-8bd9-928f1ff470e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:29 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cc698b2-e0f7-42e9-a776-d163a549e49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:29 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] Volume 13b34923-9a08-4d68-95c7-de8de99bdb57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13b34923-9a08-4d68-95c7-de8de99bdb57', 'volume_size': 1} Jul 21 02:19:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:29 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-396161370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13b34923-9a08-4d68-95c7-de8de99bdb57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40987ee8716d4814a159da93357d0724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:19:30Z,use_quota=True,user_id='3c21d4bde095491c9913ef94aa82cfb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:19:29 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] Creating volume 13b34923-9a08-4d68-95c7-de8de99bdb57 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:19:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:29 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:29 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:29 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:19:29 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:19:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:29 devstack sudo[103130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57 1073741824 Jul 21 02:19:29 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:30 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57 1073741824" returned: 0 in 0.484s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:30 devstack sudo[103136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57 Jul 21 02:19:30 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:30 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57" returned: 0 in 0.255s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:30 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:19:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cc698b2-e0f7-42e9-a776-d163a549e49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13b34923-9a08-4d68-95c7-de8de99bdb57', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dba1a05-b71b-444c-a16d-bf6cc7c9c3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:30 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] Volume volume-13b34923-9a08-4d68-95c7-de8de99bdb57 (13b34923-9a08-4d68-95c7-de8de99bdb57): created successfully Jul 21 02:19:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dba1a05-b71b-444c-a16d-bf6cc7c9c3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] Flow 'volume_create_manager' (b2433f28-050a-45bf-a054-a0ac9078d3af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:19:30 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-6fdff58c-fa15-41ef-a45b-66d372ca4065 tempest-VolumeDependencyTests-360232418 None] Created volume successfully. Jul 21 02:19:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f08510fa-e39d-4320-b31e-64f6c06cbcf9 tempest-VolumeDependencyTests-360232418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f08510fa-e39d-4320-b31e-64f6c06cbcf9 tempest-VolumeDependencyTests-360232418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:32 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-f08510fa-e39d-4320-b31e-64f6c06cbcf9 tempest-VolumeDependencyTests-360232418 None] Creating offline snapshot 1416b8c6-566c-4df2-a3b9-fe9f45231516 of volume 13b34923-9a08-4d68-95c7-de8de99bdb57 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:19:32 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[0059767a-a87b-4854-b341-dcc5a451352e]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:19:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f08510fa-e39d-4320-b31e-64f6c06cbcf9 tempest-VolumeDependencyTests-360232418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:32 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57 Jul 21 02:19:32 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:32 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f08510fa-e39d-4320-b31e-64f6c06cbcf9 tempest-VolumeDependencyTests-360232418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57" returned: 0 in 0.401s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f08510fa-e39d-4320-b31e-64f6c06cbcf9 tempest-VolumeDependencyTests-360232418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57.1416b8c6-566c-4df2-a3b9-fe9f45231516 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:32 devstack sudo[103151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57.1416b8c6-566c-4df2-a3b9-fe9f45231516 1G Jul 21 02:19:32 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:32 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:19:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] Flow 'volume_create_manager' (1d420bcf-c33a-4c25-8fa5-b2dc97fc1591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:19:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddfdbf59-df02-4486-81c1-a9297ba15f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddfdbf59-df02-4486-81c1-a9297ba15f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-694598120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23c61fa0-4b9d-49ae-acda-8da0be7fe8d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a5f27e40cf49528622399d741236d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:19:33Z,use_quota=True,user_id='15ea809e45fa4a16af183de982b12565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (885049d1-d0e3-4664-bdaa-75ca2b4c6db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (885049d1-d0e3-4664-bdaa-75ca2b4c6db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89cfd73f-5d78-4de3-8412-757efca224f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89cfd73f-5d78-4de3-8412-757efca224f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23c61fa0-4b9d-49ae-acda-8da0be7fe8d8', 'volume_name': 'volume-23c61fa0-4b9d-49ae-acda-8da0be7fe8d8', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48aa148-a879-490a-b8c5-e633308c36ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48aa148-a879-490a-b8c5-e633308c36ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:32 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6509ffae-4128-423c-b2fd-86b872e26651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:32 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] Volume 23c61fa0-4b9d-49ae-acda-8da0be7fe8d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23c61fa0-4b9d-49ae-acda-8da0be7fe8d8', 'volume_size': 1} Jul 21 02:19:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:32 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f08510fa-e39d-4320-b31e-64f6c06cbcf9 tempest-VolumeDependencyTests-360232418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57.1416b8c6-566c-4df2-a3b9-fe9f45231516 1G" returned: 0 in 0.415s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f08510fa-e39d-4320-b31e-64f6c06cbcf9 tempest-VolumeDependencyTests-360232418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13b34923-9a08-4d68-95c7-de8de99bdb57 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57.1416b8c6-566c-4df2-a3b9-fe9f45231516 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:32 devstack sudo[103157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13b34923-9a08-4d68-95c7-de8de99bdb57 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57.1416b8c6-566c-4df2-a3b9-fe9f45231516 Jul 21 02:19:32 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:33 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f08510fa-e39d-4320-b31e-64f6c06cbcf9 tempest-VolumeDependencyTests-360232418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13b34923-9a08-4d68-95c7-de8de99bdb57 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57.1416b8c6-566c-4df2-a3b9-fe9f45231516" returned: 0 in 0.287s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:33 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-f08510fa-e39d-4320-b31e-64f6c06cbcf9 tempest-VolumeDependencyTests-360232418 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57.1416b8c6-566c-4df2-a3b9-fe9f45231516 is being set with open permissions: ugo+rw Jul 21 02:19:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f08510fa-e39d-4320-b31e-64f6c06cbcf9 tempest-VolumeDependencyTests-360232418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57.1416b8c6-566c-4df2-a3b9-fe9f45231516 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:33 devstack sudo[103162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57.1416b8c6-566c-4df2-a3b9-fe9f45231516 Jul 21 02:19:33 devstack sudo[103162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:33 devstack sudo[103162]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f08510fa-e39d-4320-b31e-64f6c06cbcf9 tempest-VolumeDependencyTests-360232418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57.1416b8c6-566c-4df2-a3b9-fe9f45231516" returned: 0 in 0.233s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f08510fa-e39d-4320-b31e-64f6c06cbcf9 tempest-VolumeDependencyTests-360232418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:33 devstack sudo[103165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57.info Jul 21 02:19:33 devstack sudo[103165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:33 devstack sudo[103165]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f08510fa-e39d-4320-b31e-64f6c06cbcf9 tempest-VolumeDependencyTests-360232418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57.info" returned: 0 in 0.240s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:33 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-f08510fa-e39d-4320-b31e-64f6c06cbcf9 tempest-VolumeDependencyTests-360232418 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57.info is being set with open permissions: ugo+rw Jul 21 02:19:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f08510fa-e39d-4320-b31e-64f6c06cbcf9 tempest-VolumeDependencyTests-360232418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:33 devstack sudo[103168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57.info Jul 21 02:19:33 devstack sudo[103168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:33 devstack sudo[103168]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f08510fa-e39d-4320-b31e-64f6c06cbcf9 tempest-VolumeDependencyTests-360232418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57.info" returned: 0 in 0.235s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f08510fa-e39d-4320-b31e-64f6c06cbcf9 tempest-VolumeDependencyTests-360232418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.895s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.198s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:33 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-694598120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23c61fa0-4b9d-49ae-acda-8da0be7fe8d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a5f27e40cf49528622399d741236d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:19:33Z,use_quota=True,user_id='15ea809e45fa4a16af183de982b12565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:19:33 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] Creating volume 23c61fa0-4b9d-49ae-acda-8da0be7fe8d8 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:19:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:33 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:33 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:33 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:19:33 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:19:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-23c61fa0-4b9d-49ae-acda-8da0be7fe8d8 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:33 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-23c61fa0-4b9d-49ae-acda-8da0be7fe8d8 1073741824 Jul 21 02:19:33 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:34 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-f08510fa-e39d-4320-b31e-64f6c06cbcf9 tempest-VolumeDependencyTests-360232418 None] Create snapshot completed successfully Jul 21 02:19:34 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-23c61fa0-4b9d-49ae-acda-8da0be7fe8d8 1073741824" returned: 0 in 0.431s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-23c61fa0-4b9d-49ae-acda-8da0be7fe8d8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:34 devstack sudo[103176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-23c61fa0-4b9d-49ae-acda-8da0be7fe8d8 Jul 21 02:19:34 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:19:34 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-23c61fa0-4b9d-49ae-acda-8da0be7fe8d8" returned: 0 in 0.276s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Flow 'volume_create_manager' (c7617a6f-387b-4c84-86de-725ba6d7e30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7891fa5-99dc-4bba-beca-9a6979757398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6509ffae-4128-423c-b2fd-86b872e26651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23c61fa0-4b9d-49ae-acda-8da0be7fe8d8', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb2aa83-81fd-4304-80c0-e7f11dabf7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7891fa5-99dc-4bba-beca-9a6979757398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-458654590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11cef95b-549e-46a1-8904-a453993f185c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40987ee8716d4814a159da93357d0724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1416b8c6-566c-4df2-a3b9-fe9f45231516,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:19:35Z,use_quota=True,user_id='3c21d4bde095491c9913ef94aa82cfb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (316b8c5a-891d-4bdf-a2cc-f0a8185ac8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (316b8c5a-891d-4bdf-a2cc-f0a8185ac8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2075dfbb-6ad3-4c8a-b336-76448e59432c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2075dfbb-6ad3-4c8a-b336-76448e59432c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '11cef95b-549e-46a1-8904-a453993f185c', 'volume_name': 'volume-11cef95b-549e-46a1-8904-a453993f185c', 'volume_size': 1, 'snapshot_id': '1416b8c6-566c-4df2-a3b9-fe9f45231516'}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74071462-891f-4310-a9ae-34e0d8daf618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74071462-891f-4310-a9ae-34e0d8daf618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (671137ac-0fb1-4078-a77b-bfa142909b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:34 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Volume 11cef95b-549e-46a1-8904-a453993f185c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-11cef95b-549e-46a1-8904-a453993f185c', 'volume_size': 1, 'snapshot_id': '1416b8c6-566c-4df2-a3b9-fe9f45231516'} Jul 21 02:19:34 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] Volume volume-23c61fa0-4b9d-49ae-acda-8da0be7fe8d8 (23c61fa0-4b9d-49ae-acda-8da0be7fe8d8): created successfully Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb2aa83-81fd-4304-80c0-e7f11dabf7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] Flow 'volume_create_manager' (1d420bcf-c33a-4c25-8fa5-b2dc97fc1591) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Acquiring lock "cinder-quobyte-1416b8c6-566c-4df2-a3b9-fe9f45231516-11cef95b-549e-46a1-8904-a453993f185c" by "_create_volume_from_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:34 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-32fad145-19a8-4d0e-9a7e-2cf0e7d94b58 tempest-ProjectReaderTests-1354926172 None] Created volume successfully. Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Lock "cinder-quobyte-1416b8c6-566c-4df2-a3b9-fe9f45231516-11cef95b-549e-46a1-8904-a453993f185c" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Creating volume 11cef95b-549e-46a1-8904-a453993f185c from snapshot 1416b8c6-566c-4df2-a3b9-fe9f45231516 {{(pid=87566) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Acquiring lock "cinder-quobyte-11cef95b-549e-46a1-8904-a453993f185c" by "_copy_volume_from_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Lock "cinder-quobyte-11cef95b-549e-46a1-8904-a453993f185c" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] snapshot: 1416b8c6-566c-4df2-a3b9-fe9f45231516, volume: 11cef95b-549e-46a1-8904-a453993f185c, {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bffc8ea-789b-4492-89bb-04da46e26495]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:19:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57.1416b8c6-566c-4df2-a3b9-fe9f45231516 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:35 devstack sudo[103179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57.1416b8c6-566c-4df2-a3b9-fe9f45231516 Jul 21 02:19:35 devstack sudo[103179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:35 devstack sudo[103179]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57.1416b8c6-566c-4df2-a3b9-fe9f45231516" returned: 0 in 0.354s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:35 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13b34923-9a08-4d68-95c7-de8de99bdb57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:19:35 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57 {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 02:19:35 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Creating direct copy from snapshot {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 02:19:35 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[e977be65-c385-48a9-9210-f2df078a7b25]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:19:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:35 devstack sudo[103184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57 Jul 21 02:19:35 devstack sudo[103184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:35 devstack sudo[103184]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57" returned: 0 in 0.369s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:35 devstack cinder-volume[87566]: DEBUG cinder.utils [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Path /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-11cef95b-549e-46a1-8904-a453993f185c not found in is_blk_device check {{(pid=87566) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 02:19:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-11cef95b-549e-46a1-8904-a453993f185c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:35 devstack sudo[103189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-11cef95b-549e-46a1-8904-a453993f185c Jul 21 02:19:35 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:35 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c03bbd87-fe8b-44d5-9d2a-0609d88dcc2e tempest-ProjectReaderTests-1354926172 None] Acquiring lock "cinder-23c61fa0-4b9d-49ae-acda-8da0be7fe8d8-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:36 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c03bbd87-fe8b-44d5-9d2a-0609d88dcc2e tempest-ProjectReaderTests-1354926172 None] Lock "cinder-23c61fa0-4b9d-49ae-acda-8da0be7fe8d8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:36 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c03bbd87-fe8b-44d5-9d2a-0609d88dcc2e tempest-ProjectReaderTests-1354926172 None] Acquiring lock "cinder-quobyte-23c61fa0-4b9d-49ae-acda-8da0be7fe8d8" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:36 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c03bbd87-fe8b-44d5-9d2a-0609d88dcc2e tempest-ProjectReaderTests-1354926172 None] Lock "cinder-quobyte-23c61fa0-4b9d-49ae-acda-8da0be7fe8d8" acquired by "delete_volume" :: waited 0.018s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:36 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21f4587-bffb-43e7-a3bc-569c974969d5]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:19:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c03bbd87-fe8b-44d5-9d2a-0609d88dcc2e tempest-ProjectReaderTests-1354926172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-23c61fa0-4b9d-49ae-acda-8da0be7fe8d8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:36 devstack sudo[103195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-23c61fa0-4b9d-49ae-acda-8da0be7fe8d8 Jul 21 02:19:36 devstack sudo[103195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:36 devstack sudo[103195]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c03bbd87-fe8b-44d5-9d2a-0609d88dcc2e tempest-ProjectReaderTests-1354926172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-23c61fa0-4b9d-49ae-acda-8da0be7fe8d8" returned: 0 in 0.784s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c03bbd87-fe8b-44d5-9d2a-0609d88dcc2e tempest-ProjectReaderTests-1354926172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-23c61fa0-4b9d-49ae-acda-8da0be7fe8d8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:36 devstack sudo[103214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-23c61fa0-4b9d-49ae-acda-8da0be7fe8d8 Jul 21 02:19:36 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:37 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c03bbd87-fe8b-44d5-9d2a-0609d88dcc2e tempest-ProjectReaderTests-1354926172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-23c61fa0-4b9d-49ae-acda-8da0be7fe8d8" returned: 0 in 0.842s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:37 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c03bbd87-fe8b-44d5-9d2a-0609d88dcc2e tempest-ProjectReaderTests-1354926172 None] Lock "cinder-quobyte-23c61fa0-4b9d-49ae-acda-8da0be7fe8d8" released by "delete_volume" :: held 1.687s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:37 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-c03bbd87-fe8b-44d5-9d2a-0609d88dcc2e tempest-ProjectReaderTests-1354926172 None] Created reservations ['80277fe1-3d08-4b5c-a52c-fe3617f7b7bb', 'ed178dfd-1805-4742-b326-181a3b39315a', '846675cd-5855-434a-8484-9779785c2034', 'eaea97cf-d39e-4945-a3d9-b4651325ccdc'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:19:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c03bbd87-fe8b-44d5-9d2a-0609d88dcc2e tempest-ProjectReaderTests-1354926172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c03bbd87-fe8b-44d5-9d2a-0609d88dcc2e tempest-ProjectReaderTests-1354926172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:38 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c03bbd87-fe8b-44d5-9d2a-0609d88dcc2e tempest-ProjectReaderTests-1354926172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:38 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c03bbd87-fe8b-44d5-9d2a-0609d88dcc2e tempest-ProjectReaderTests-1354926172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c03bbd87-fe8b-44d5-9d2a-0609d88dcc2e tempest-ProjectReaderTests-1354926172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c03bbd87-fe8b-44d5-9d2a-0609d88dcc2e tempest-ProjectReaderTests-1354926172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:38 devstack sudo[103224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:19:38 devstack sudo[103224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:38 devstack sudo[103224]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c03bbd87-fe8b-44d5-9d2a-0609d88dcc2e tempest-ProjectReaderTests-1354926172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.424s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:38 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-c03bbd87-fe8b-44d5-9d2a-0609d88dcc2e tempest-ProjectReaderTests-1354926172 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:19:38 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-c03bbd87-fe8b-44d5-9d2a-0609d88dcc2e tempest-ProjectReaderTests-1354926172 None] Deleted volume successfully. Jul 21 02:19:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-bf5f64f9-4e23-4822-9043-d573d7bd5a9e req-248d2d28-97e9-4bac-8095-e457e8725376 tempest-TestInstancesWithCinderVolumes-1617127660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:38 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c03bbd87-fe8b-44d5-9d2a-0609d88dcc2e tempest-ProjectReaderTests-1354926172 None] Lock "cinder-23c61fa0-4b9d-49ae-acda-8da0be7fe8d8-delete_volume" released by "delete_volume" :: held 2.536s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:39 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:19:39 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] Flow 'volume_create_manager' (b9449e2a-1697-40b2-a3e6-9a4bef3e74f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:19:39 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c46b9f2-2340-49da-8184-42b871cd2863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:39 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c46b9f2-2340-49da-8184-42b871cd2863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1930240227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afa5a54e-d6e6-4092-bdb2-10c2cb21c4f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a5f27e40cf49528622399d741236d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:19:39Z,use_quota=True,user_id='15ea809e45fa4a16af183de982b12565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:39 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23e4830e-2600-4a64-935a-7127ef9e6c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:39 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23e4830e-2600-4a64-935a-7127ef9e6c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:39 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1146bb2d-3c76-4d55-b02c-a015ee6a0436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:39 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1146bb2d-3c76-4d55-b02c-a015ee6a0436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afa5a54e-d6e6-4092-bdb2-10c2cb21c4f8', 'volume_name': 'volume-afa5a54e-d6e6-4092-bdb2-10c2cb21c4f8', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:39 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34dc7b07-6f8e-4d45-8c91-0522928e2fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:39 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34dc7b07-6f8e-4d45-8c91-0522928e2fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:39 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eab24564-7234-49d7-8c0f-35b307ae713f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:39 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] Volume afa5a54e-d6e6-4092-bdb2-10c2cb21c4f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afa5a54e-d6e6-4092-bdb2-10c2cb21c4f8', 'volume_size': 1} Jul 21 02:19:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:40 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-11cef95b-549e-46a1-8904-a453993f185c" returned: 0 in 5.033s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:40 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[3291ab97-01c4-4ecd-a695-0870b7e866ca]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:19:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:40 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57 Jul 21 02:19:40 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:41 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57" returned: 0 in 0.514s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:41 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Image conversion details: src /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57, size 1024.00 MB, duration 5.03 sec, destination /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-11cef95b-549e-46a1-8904-a453993f185c {{(pid=87566) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 02:19:41 devstack cinder-volume[87566]: INFO cinder.image.image_utils [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Converted 1024.00 MB image at 203.42 MB/s Jul 21 02:19:41 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-11cef95b-549e-46a1-8904-a453993f185c is being set with open permissions: ugo+rw Jul 21 02:19:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-11cef95b-549e-46a1-8904-a453993f185c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:41 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-11cef95b-549e-46a1-8904-a453993f185c Jul 21 02:19:41 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:41 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-11cef95b-549e-46a1-8904-a453993f185c" returned: 0 in 0.237s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:41 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Lock "cinder-quobyte-11cef95b-549e-46a1-8904-a453993f185c" released by "_copy_volume_from_snapshot" :: held 6.588s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:41 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Lock "cinder-quobyte-1416b8c6-566c-4df2-a3b9-fe9f45231516-11cef95b-549e-46a1-8904-a453993f185c" released by "_create_volume_from_snapshot" :: held 6.614s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.635s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-bf5f64f9-4e23-4822-9043-d573d7bd5a9e req-248d2d28-97e9-4bac-8095-e457e8725376 tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.966s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-bf5f64f9-4e23-4822-9043-d573d7bd5a9e req-248d2d28-97e9-4bac-8095-e457e8725376 tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.908s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:41 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1930240227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afa5a54e-d6e6-4092-bdb2-10c2cb21c4f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a5f27e40cf49528622399d741236d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:19:39Z,use_quota=True,user_id='15ea809e45fa4a16af183de982b12565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:19:41 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] Creating volume afa5a54e-d6e6-4092-bdb2-10c2cb21c4f8 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:19:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:41 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:41 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:41 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:19:41 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:19:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-afa5a54e-d6e6-4092-bdb2-10c2cb21c4f8 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (671137ac-0fb1-4078-a77b-bfa142909b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11cef95b-549e-46a1-8904-a453993f185c', 'volume_size': 1, 'snapshot_id': '1416b8c6-566c-4df2-a3b9-fe9f45231516'}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:41 devstack sudo[103236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-afa5a54e-d6e6-4092-bdb2-10c2cb21c4f8 1073741824 Jul 21 02:19:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a644b0b9-5157-4c26-8add-a30862121ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:41 devstack sudo[103236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:41 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Volume volume-11cef95b-549e-46a1-8904-a453993f185c (11cef95b-549e-46a1-8904-a453993f185c): created successfully Jul 21 02:19:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a644b0b9-5157-4c26-8add-a30862121ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Flow 'volume_create_manager' (c7617a6f-387b-4c84-86de-725ba6d7e30e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:19:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-bf5f64f9-4e23-4822-9043-d573d7bd5a9e req-248d2d28-97e9-4bac-8095-e457e8725376 tempest-TestInstancesWithCinderVolumes-1617127660 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea', 'name': 'volume-b10d0d16-be6c-4518-9b86-2e34daea0115', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3cb46e21-a7ed-46ba-ad68-4e8650163bc1', 'enforce_multipath': True} {{(pid=87566) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 02:19:41 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-168f0473-9092-4115-bd62-89d154474d38 tempest-VolumeDependencyTests-360232418 None] Created volume successfully. Jul 21 02:19:41 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-bf5f64f9-4e23-4822-9043-d573d7bd5a9e req-248d2d28-97e9-4bac-8095-e457e8725376 tempest-TestInstancesWithCinderVolumes-1617127660 None] attachment_update completed successfully. Jul 21 02:19:41 devstack sudo[103236]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-afa5a54e-d6e6-4092-bdb2-10c2cb21c4f8 1073741824" returned: 0 in 0.449s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-afa5a54e-d6e6-4092-bdb2-10c2cb21c4f8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:42 devstack sudo[103245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-afa5a54e-d6e6-4092-bdb2-10c2cb21c4f8 Jul 21 02:19:42 devstack sudo[103245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:42 devstack sudo[103245]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-afa5a54e-d6e6-4092-bdb2-10c2cb21c4f8" returned: 0 in 0.247s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:42 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:19:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eab24564-7234-49d7-8c0f-35b307ae713f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afa5a54e-d6e6-4092-bdb2-10c2cb21c4f8', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60301ea-4b62-4880-80cc-d6054a65c542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:42 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] Volume volume-afa5a54e-d6e6-4092-bdb2-10c2cb21c4f8 (afa5a54e-d6e6-4092-bdb2-10c2cb21c4f8): created successfully Jul 21 02:19:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60301ea-4b62-4880-80cc-d6054a65c542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] Flow 'volume_create_manager' (b9449e2a-1697-40b2-a3e6-9a4bef3e74f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:19:42 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-d53892a4-5fd2-45d3-9a5e-8fabcde531a9 tempest-ProjectReaderTests-1354926172 None] Created volume successfully. Jul 21 02:19:42 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4dda7a80-1557-44f7-863b-e0ab0ca2de3e tempest-VolumeDependencyTests-360232418 None] Acquiring lock "cinder-1416b8c6-566c-4df2-a3b9-fe9f45231516-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:42 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4dda7a80-1557-44f7-863b-e0ab0ca2de3e tempest-VolumeDependencyTests-360232418 None] Lock "cinder-1416b8c6-566c-4df2-a3b9-fe9f45231516-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:42 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4dda7a80-1557-44f7-863b-e0ab0ca2de3e tempest-VolumeDependencyTests-360232418 None] Acquiring lock "cinder-quobyte-13b34923-9a08-4d68-95c7-de8de99bdb57" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:42 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4dda7a80-1557-44f7-863b-e0ab0ca2de3e tempest-VolumeDependencyTests-360232418 None] Lock "cinder-quobyte-13b34923-9a08-4d68-95c7-de8de99bdb57" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:42 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4dda7a80-1557-44f7-863b-e0ab0ca2de3e tempest-VolumeDependencyTests-360232418 None] Acquiring lock "cinder-quobyte-1416b8c6-566c-4df2-a3b9-fe9f45231516" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:42 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4dda7a80-1557-44f7-863b-e0ab0ca2de3e tempest-VolumeDependencyTests-360232418 None] Lock "cinder-quobyte-1416b8c6-566c-4df2-a3b9-fe9f45231516" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:42 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-4dda7a80-1557-44f7-863b-e0ab0ca2de3e tempest-VolumeDependencyTests-360232418 None] Deleting offline snapshot 1416b8c6-566c-4df2-a3b9-fe9f45231516 of volume 13b34923-9a08-4d68-95c7-de8de99bdb57 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:19:42 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-4dda7a80-1557-44f7-863b-e0ab0ca2de3e tempest-VolumeDependencyTests-360232418 None] snapshot_file for this snap is: volume-13b34923-9a08-4d68-95c7-de8de99bdb57.1416b8c6-566c-4df2-a3b9-fe9f45231516 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:19:42 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a84f3f-5b13-4eb1-b51e-c303747cc09b]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:19:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4dda7a80-1557-44f7-863b-e0ab0ca2de3e tempest-VolumeDependencyTests-360232418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57.1416b8c6-566c-4df2-a3b9-fe9f45231516 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:42 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cf57fb82-25a6-4330-bfa4-271d9218a20e tempest-ProjectReaderTests-1354926172 None] Acquiring lock "cinder-afa5a54e-d6e6-4092-bdb2-10c2cb21c4f8-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:42 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cf57fb82-25a6-4330-bfa4-271d9218a20e tempest-ProjectReaderTests-1354926172 None] Lock "cinder-afa5a54e-d6e6-4092-bdb2-10c2cb21c4f8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:42 devstack sudo[103252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57.1416b8c6-566c-4df2-a3b9-fe9f45231516 Jul 21 02:19:42 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:42 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cf57fb82-25a6-4330-bfa4-271d9218a20e tempest-ProjectReaderTests-1354926172 None] Acquiring lock "cinder-quobyte-afa5a54e-d6e6-4092-bdb2-10c2cb21c4f8" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:42 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cf57fb82-25a6-4330-bfa4-271d9218a20e tempest-ProjectReaderTests-1354926172 None] Lock "cinder-quobyte-afa5a54e-d6e6-4092-bdb2-10c2cb21c4f8" acquired by "delete_volume" :: waited 0.021s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:42 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc2baf7-d4d7-4f8c-8e02-df6138139f72]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:19:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cf57fb82-25a6-4330-bfa4-271d9218a20e tempest-ProjectReaderTests-1354926172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-afa5a54e-d6e6-4092-bdb2-10c2cb21c4f8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:42 devstack sudo[103257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-afa5a54e-d6e6-4092-bdb2-10c2cb21c4f8 Jul 21 02:19:42 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:43 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4dda7a80-1557-44f7-863b-e0ab0ca2de3e tempest-VolumeDependencyTests-360232418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57.1416b8c6-566c-4df2-a3b9-fe9f45231516" returned: 0 in 0.435s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:43 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-4dda7a80-1557-44f7-863b-e0ab0ca2de3e tempest-VolumeDependencyTests-360232418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13b34923-9a08-4d68-95c7-de8de99bdb57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:19:43 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d6b8a7-3baf-4957-81ff-848cb5cfa571]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:19:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4dda7a80-1557-44f7-863b-e0ab0ca2de3e tempest-VolumeDependencyTests-360232418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:43 devstack sudo[103265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57 Jul 21 02:19:43 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:43 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cf57fb82-25a6-4330-bfa4-271d9218a20e tempest-ProjectReaderTests-1354926172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-afa5a54e-d6e6-4092-bdb2-10c2cb21c4f8" returned: 0 in 0.419s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cf57fb82-25a6-4330-bfa4-271d9218a20e tempest-ProjectReaderTests-1354926172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-afa5a54e-d6e6-4092-bdb2-10c2cb21c4f8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:43 devstack sudo[103270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-afa5a54e-d6e6-4092-bdb2-10c2cb21c4f8 Jul 21 02:19:43 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:43 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4dda7a80-1557-44f7-863b-e0ab0ca2de3e tempest-VolumeDependencyTests-360232418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57" returned: 0 in 0.408s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4dda7a80-1557-44f7-863b-e0ab0ca2de3e tempest-VolumeDependencyTests-360232418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57.1416b8c6-566c-4df2-a3b9-fe9f45231516 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:43 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57.1416b8c6-566c-4df2-a3b9-fe9f45231516 Jul 21 02:19:43 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:43 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cf57fb82-25a6-4330-bfa4-271d9218a20e tempest-ProjectReaderTests-1354926172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-afa5a54e-d6e6-4092-bdb2-10c2cb21c4f8" returned: 0 in 0.295s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:43 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cf57fb82-25a6-4330-bfa4-271d9218a20e tempest-ProjectReaderTests-1354926172 None] Lock "cinder-quobyte-afa5a54e-d6e6-4092-bdb2-10c2cb21c4f8" released by "delete_volume" :: held 0.765s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-04c47289-a703-45bc-9f50-0236b6b7dc1f req-e156f040-b1bb-4301-bb56-804255748c22 tempest-TestInstancesWithCinderVolumes-1617127660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-04c47289-a703-45bc-9f50-0236b6b7dc1f req-e156f040-b1bb-4301-bb56-804255748c22 tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-04c47289-a703-45bc-9f50-0236b6b7dc1f req-e156f040-b1bb-4301-bb56-804255748c22 tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:43 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-cf57fb82-25a6-4330-bfa4-271d9218a20e tempest-ProjectReaderTests-1354926172 None] Created reservations ['2177dfb7-510b-4720-ab6c-aea581add3ba', '831784ea-e23e-4ef4-9cb5-65ff85dc47d3', '7d105a4e-7a39-4c37-9d93-32ca051743ab', '350977e4-5456-4118-b6b6-7a080a7c9b7c'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:19:43 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-04c47289-a703-45bc-9f50-0236b6b7dc1f req-e156f040-b1bb-4301-bb56-804255748c22 tempest-TestInstancesWithCinderVolumes-1617127660 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea', 'name': 'volume-b2726e0e-ee3e-4736-b07d-eb98066a5c04', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d7218e1-f288-46ef-809a-064fa3083cdc', 'enforce_multipath': True} {{(pid=87566) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 02:19:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cf57fb82-25a6-4330-bfa4-271d9218a20e tempest-ProjectReaderTests-1354926172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cf57fb82-25a6-4330-bfa4-271d9218a20e tempest-ProjectReaderTests-1354926172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:43 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cf57fb82-25a6-4330-bfa4-271d9218a20e tempest-ProjectReaderTests-1354926172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:43 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cf57fb82-25a6-4330-bfa4-271d9218a20e tempest-ProjectReaderTests-1354926172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cf57fb82-25a6-4330-bfa4-271d9218a20e tempest-ProjectReaderTests-1354926172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cf57fb82-25a6-4330-bfa4-271d9218a20e tempest-ProjectReaderTests-1354926172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:43 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:19:43 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:43 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-04c47289-a703-45bc-9f50-0236b6b7dc1f req-e156f040-b1bb-4301-bb56-804255748c22 tempest-TestInstancesWithCinderVolumes-1617127660 None] attachment_update completed successfully. Jul 21 02:19:43 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4dda7a80-1557-44f7-863b-e0ab0ca2de3e tempest-VolumeDependencyTests-360232418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57.1416b8c6-566c-4df2-a3b9-fe9f45231516" returned: 0 in 0.403s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4dda7a80-1557-44f7-863b-e0ab0ca2de3e tempest-VolumeDependencyTests-360232418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57.1416b8c6-566c-4df2-a3b9-fe9f45231516 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:43 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57.1416b8c6-566c-4df2-a3b9-fe9f45231516 Jul 21 02:19:43 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:44 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cf57fb82-25a6-4330-bfa4-271d9218a20e tempest-ProjectReaderTests-1354926172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.304s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-cf57fb82-25a6-4330-bfa4-271d9218a20e tempest-ProjectReaderTests-1354926172 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:19:44 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-cf57fb82-25a6-4330-bfa4-271d9218a20e tempest-ProjectReaderTests-1354926172 None] Deleted volume successfully. Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cf57fb82-25a6-4330-bfa4-271d9218a20e tempest-ProjectReaderTests-1354926172 None] Lock "cinder-afa5a54e-d6e6-4092-bdb2-10c2cb21c4f8-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:44 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4dda7a80-1557-44f7-863b-e0ab0ca2de3e tempest-VolumeDependencyTests-360232418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57.1416b8c6-566c-4df2-a3b9-fe9f45231516" returned: 0 in 0.358s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4dda7a80-1557-44f7-863b-e0ab0ca2de3e tempest-VolumeDependencyTests-360232418 None] Lock "cinder-quobyte-1416b8c6-566c-4df2-a3b9-fe9f45231516" released by "_delete_snapshot" :: held 1.736s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4dda7a80-1557-44f7-863b-e0ab0ca2de3e tempest-VolumeDependencyTests-360232418 None] Lock "cinder-quobyte-13b34923-9a08-4d68-95c7-de8de99bdb57" released by "delete_snapshot" :: held 1.769s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-4dda7a80-1557-44f7-863b-e0ab0ca2de3e tempest-VolumeDependencyTests-360232418 None] Created reservations ['804eb025-7a4e-44cd-a385-c09730695ca8', '415d2f16-5bb0-4c1e-ad6a-a1e46fd28302', '3834d026-5b15-422f-8a13-a2d16dc9f299', '6a2ce071-22ce-4107-b055-fd345c5b5f47'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:19:44 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-4dda7a80-1557-44f7-863b-e0ab0ca2de3e tempest-VolumeDependencyTests-360232418 None] Delete snapshot completed successfully. Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4dda7a80-1557-44f7-863b-e0ab0ca2de3e tempest-VolumeDependencyTests-360232418 None] Lock "cinder-1416b8c6-566c-4df2-a3b9-fe9f45231516-delete_snapshot" released by "delete_snapshot" :: held 1.969s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] Flow 'volume_create_manager' (a564e37a-1714-41c7-ab46-7242b5909453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d46827d6-3305-4e20-a413-2f9a0d1081ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d46827d6-3305-4e20-a413-2f9a0d1081ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-437890083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e9c6be6-8f2b-437a-9e26-f0c01aaea292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a5f27e40cf49528622399d741236d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:19:44Z,use_quota=True,user_id='15ea809e45fa4a16af183de982b12565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75c45889-3b4b-43f1-ae81-f7ce0c6896db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75c45889-3b4b-43f1-ae81-f7ce0c6896db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d94a526-0931-40f7-833d-19a474703b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d94a526-0931-40f7-833d-19a474703b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e9c6be6-8f2b-437a-9e26-f0c01aaea292', 'volume_name': 'volume-8e9c6be6-8f2b-437a-9e26-f0c01aaea292', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ae8203d-6aae-4cf2-b7ba-9a8affbcce54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ae8203d-6aae-4cf2-b7ba-9a8affbcce54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (379bf1ae-3008-454b-923e-2ec789cc30c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:44 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] Volume 8e9c6be6-8f2b-437a-9e26-f0c01aaea292: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e9c6be6-8f2b-437a-9e26-f0c01aaea292', 'volume_size': 1} Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-437890083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e9c6be6-8f2b-437a-9e26-f0c01aaea292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a5f27e40cf49528622399d741236d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:19:44Z,use_quota=True,user_id='15ea809e45fa4a16af183de982b12565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] Creating volume 8e9c6be6-8f2b-437a-9e26-f0c01aaea292 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:19:44 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8e9c6be6-8f2b-437a-9e26-f0c01aaea292 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:44 devstack sudo[103299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8e9c6be6-8f2b-437a-9e26-f0c01aaea292 1073741824 Jul 21 02:19:44 devstack sudo[103299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cfc5e7dc-b883-4d53-8cdc-633173111479 tempest-VolumeDependencyTests-360232418 None] Acquiring lock "cinder-13b34923-9a08-4d68-95c7-de8de99bdb57-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cfc5e7dc-b883-4d53-8cdc-633173111479 tempest-VolumeDependencyTests-360232418 None] Lock "cinder-13b34923-9a08-4d68-95c7-de8de99bdb57-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cfc5e7dc-b883-4d53-8cdc-633173111479 tempest-VolumeDependencyTests-360232418 None] Acquiring lock "cinder-quobyte-13b34923-9a08-4d68-95c7-de8de99bdb57" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cfc5e7dc-b883-4d53-8cdc-633173111479 tempest-VolumeDependencyTests-360232418 None] Lock "cinder-quobyte-13b34923-9a08-4d68-95c7-de8de99bdb57" acquired by "delete_volume" :: waited 0.014s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[51726999-2c9e-4605-a3f8-f302b42e2f4e]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cfc5e7dc-b883-4d53-8cdc-633173111479 tempest-VolumeDependencyTests-360232418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:44 devstack sudo[103301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57 Jul 21 02:19:44 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:44 devstack sudo[103299]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8e9c6be6-8f2b-437a-9e26-f0c01aaea292 1073741824" returned: 0 in 0.427s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8e9c6be6-8f2b-437a-9e26-f0c01aaea292 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:45 devstack sudo[103307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8e9c6be6-8f2b-437a-9e26-f0c01aaea292 Jul 21 02:19:45 devstack sudo[103307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:45 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cfc5e7dc-b883-4d53-8cdc-633173111479 tempest-VolumeDependencyTests-360232418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57" returned: 0 in 0.371s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cfc5e7dc-b883-4d53-8cdc-633173111479 tempest-VolumeDependencyTests-360232418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:45 devstack sudo[103312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57 Jul 21 02:19:45 devstack sudo[103312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:45 devstack sudo[103307]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8e9c6be6-8f2b-437a-9e26-f0c01aaea292" returned: 0 in 0.273s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:45 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:19:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (379bf1ae-3008-454b-923e-2ec789cc30c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e9c6be6-8f2b-437a-9e26-f0c01aaea292', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ad5967-0c1a-43fb-96e1-d017d6838f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:45 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] Volume volume-8e9c6be6-8f2b-437a-9e26-f0c01aaea292 (8e9c6be6-8f2b-437a-9e26-f0c01aaea292): created successfully Jul 21 02:19:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ad5967-0c1a-43fb-96e1-d017d6838f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] Flow 'volume_create_manager' (a564e37a-1714-41c7-ab46-7242b5909453) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:19:45 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-cbe3cfb3-cfe4-4a00-8852-bf83237bf9c7 tempest-ProjectReaderTests-1354926172 None] Created volume successfully. Jul 21 02:19:45 devstack sudo[103312]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cfc5e7dc-b883-4d53-8cdc-633173111479 tempest-VolumeDependencyTests-360232418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-13b34923-9a08-4d68-95c7-de8de99bdb57" returned: 0 in 0.292s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:45 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cfc5e7dc-b883-4d53-8cdc-633173111479 tempest-VolumeDependencyTests-360232418 None] Lock "cinder-quobyte-13b34923-9a08-4d68-95c7-de8de99bdb57" released by "delete_volume" :: held 0.723s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:45 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-cfc5e7dc-b883-4d53-8cdc-633173111479 tempest-VolumeDependencyTests-360232418 None] Created reservations ['03102ed8-0721-4a89-b93a-71cb5bd2b75e', '6225cbf0-6a48-41fb-946b-5d0ed539ef2b', '846f9c9d-2e09-481b-87f7-0a96f24c963d', 'e07999c9-cd57-4cd7-93d8-2bf8e491e5a7'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:19:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cfc5e7dc-b883-4d53-8cdc-633173111479 tempest-VolumeDependencyTests-360232418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cfc5e7dc-b883-4d53-8cdc-633173111479 tempest-VolumeDependencyTests-360232418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:45 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cfc5e7dc-b883-4d53-8cdc-633173111479 tempest-VolumeDependencyTests-360232418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:45 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cfc5e7dc-b883-4d53-8cdc-633173111479 tempest-VolumeDependencyTests-360232418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cfc5e7dc-b883-4d53-8cdc-633173111479 tempest-VolumeDependencyTests-360232418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cfc5e7dc-b883-4d53-8cdc-633173111479 tempest-VolumeDependencyTests-360232418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:45 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:19:45 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:45 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cfc5e7dc-b883-4d53-8cdc-633173111479 tempest-VolumeDependencyTests-360232418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.257s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:45 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-cfc5e7dc-b883-4d53-8cdc-633173111479 tempest-VolumeDependencyTests-360232418 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:19:45 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-cfc5e7dc-b883-4d53-8cdc-633173111479 tempest-VolumeDependencyTests-360232418 None] Deleted volume successfully. Jul 21 02:19:45 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e79bb9d4-dcf5-443f-96db-e8bf59e05be8 tempest-VolumeDependencyTests-360232418 None] Acquiring lock "cinder-11cef95b-549e-46a1-8904-a453993f185c-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:45 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cfc5e7dc-b883-4d53-8cdc-633173111479 tempest-VolumeDependencyTests-360232418 None] Lock "cinder-13b34923-9a08-4d68-95c7-de8de99bdb57-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:45 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e79bb9d4-dcf5-443f-96db-e8bf59e05be8 tempest-VolumeDependencyTests-360232418 None] Lock "cinder-11cef95b-549e-46a1-8904-a453993f185c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:45 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e79bb9d4-dcf5-443f-96db-e8bf59e05be8 tempest-VolumeDependencyTests-360232418 None] Acquiring lock "cinder-quobyte-11cef95b-549e-46a1-8904-a453993f185c" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:45 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e79bb9d4-dcf5-443f-96db-e8bf59e05be8 tempest-VolumeDependencyTests-360232418 None] Lock "cinder-quobyte-11cef95b-549e-46a1-8904-a453993f185c" acquired by "delete_volume" :: waited 0.017s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:45 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5eac6a-2222-4dcf-a2b3-77d0368c1498]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:19:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e79bb9d4-dcf5-443f-96db-e8bf59e05be8 tempest-VolumeDependencyTests-360232418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-11cef95b-549e-46a1-8904-a453993f185c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:46 devstack sudo[103327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-11cef95b-549e-46a1-8904-a453993f185c Jul 21 02:19:46 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:46 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e79bb9d4-dcf5-443f-96db-e8bf59e05be8 tempest-VolumeDependencyTests-360232418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-11cef95b-549e-46a1-8904-a453993f185c" returned: 0 in 0.369s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e79bb9d4-dcf5-443f-96db-e8bf59e05be8 tempest-VolumeDependencyTests-360232418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-11cef95b-549e-46a1-8904-a453993f185c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:46 devstack sudo[103332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-11cef95b-549e-46a1-8904-a453993f185c Jul 21 02:19:46 devstack sudo[103332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:46 devstack sudo[103332]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e79bb9d4-dcf5-443f-96db-e8bf59e05be8 tempest-VolumeDependencyTests-360232418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-11cef95b-549e-46a1-8904-a453993f185c" returned: 0 in 0.250s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:46 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e79bb9d4-dcf5-443f-96db-e8bf59e05be8 tempest-VolumeDependencyTests-360232418 None] Lock "cinder-quobyte-11cef95b-549e-46a1-8904-a453993f185c" released by "delete_volume" :: held 0.663s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:46 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-87393dd9-ddb4-4529-b7ac-544f01288832 tempest-ProjectReaderTests-1354926172 None] Acquiring lock "cinder-8e9c6be6-8f2b-437a-9e26-f0c01aaea292-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:46 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-87393dd9-ddb4-4529-b7ac-544f01288832 tempest-ProjectReaderTests-1354926172 None] Lock "cinder-8e9c6be6-8f2b-437a-9e26-f0c01aaea292-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:46 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-87393dd9-ddb4-4529-b7ac-544f01288832 tempest-ProjectReaderTests-1354926172 None] Acquiring lock "cinder-quobyte-8e9c6be6-8f2b-437a-9e26-f0c01aaea292" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:46 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-e79bb9d4-dcf5-443f-96db-e8bf59e05be8 tempest-VolumeDependencyTests-360232418 None] Created reservations ['0d4e31e5-581d-4893-be3c-df7cc2738d93', '32178b98-a535-47f3-8a7a-2073579e1e69', 'bad35787-1358-4c12-8507-63c9b0582188', 'ba6f042b-db6d-45d5-afb6-c25b0f361923'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:19:46 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-87393dd9-ddb4-4529-b7ac-544f01288832 tempest-ProjectReaderTests-1354926172 None] Lock "cinder-quobyte-8e9c6be6-8f2b-437a-9e26-f0c01aaea292" acquired by "delete_volume" :: waited 0.019s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:46 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf5d973-9c53-4c3f-81f1-fab8c12612c9]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:19:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-87393dd9-ddb4-4529-b7ac-544f01288832 tempest-ProjectReaderTests-1354926172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8e9c6be6-8f2b-437a-9e26-f0c01aaea292 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e79bb9d4-dcf5-443f-96db-e8bf59e05be8 tempest-VolumeDependencyTests-360232418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e79bb9d4-dcf5-443f-96db-e8bf59e05be8 tempest-VolumeDependencyTests-360232418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e79bb9d4-dcf5-443f-96db-e8bf59e05be8 tempest-VolumeDependencyTests-360232418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e79bb9d4-dcf5-443f-96db-e8bf59e05be8 tempest-VolumeDependencyTests-360232418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e79bb9d4-dcf5-443f-96db-e8bf59e05be8 tempest-VolumeDependencyTests-360232418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e79bb9d4-dcf5-443f-96db-e8bf59e05be8 tempest-VolumeDependencyTests-360232418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:46 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:19:46 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:46 devstack sudo[103335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8e9c6be6-8f2b-437a-9e26-f0c01aaea292 Jul 21 02:19:46 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:47 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e79bb9d4-dcf5-443f-96db-e8bf59e05be8 tempest-VolumeDependencyTests-360232418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.260s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:47 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-e79bb9d4-dcf5-443f-96db-e8bf59e05be8 tempest-VolumeDependencyTests-360232418 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:19:47 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-e79bb9d4-dcf5-443f-96db-e8bf59e05be8 tempest-VolumeDependencyTests-360232418 None] Deleted volume successfully. Jul 21 02:19:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e79bb9d4-dcf5-443f-96db-e8bf59e05be8 tempest-VolumeDependencyTests-360232418 None] Lock "cinder-11cef95b-549e-46a1-8904-a453993f185c-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:47 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-87393dd9-ddb4-4529-b7ac-544f01288832 tempest-ProjectReaderTests-1354926172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8e9c6be6-8f2b-437a-9e26-f0c01aaea292" returned: 0 in 0.443s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-87393dd9-ddb4-4529-b7ac-544f01288832 tempest-ProjectReaderTests-1354926172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8e9c6be6-8f2b-437a-9e26-f0c01aaea292 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:47 devstack sudo[103343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8e9c6be6-8f2b-437a-9e26-f0c01aaea292 Jul 21 02:19:47 devstack sudo[103343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:47 devstack sudo[103343]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-87393dd9-ddb4-4529-b7ac-544f01288832 tempest-ProjectReaderTests-1354926172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8e9c6be6-8f2b-437a-9e26-f0c01aaea292" returned: 0 in 0.270s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-87393dd9-ddb4-4529-b7ac-544f01288832 tempest-ProjectReaderTests-1354926172 None] Lock "cinder-quobyte-8e9c6be6-8f2b-437a-9e26-f0c01aaea292" released by "delete_volume" :: held 0.761s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:47 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-87393dd9-ddb4-4529-b7ac-544f01288832 tempest-ProjectReaderTests-1354926172 None] Created reservations ['fa4ed33d-d2eb-4753-ad06-48d5203c308c', 'e0d01cd2-d859-4c92-a886-6d0e8cae5c79', '811bda0d-153a-40e4-8652-45d915a112e7', '93eb9042-bc4e-4e7d-a367-5d3d44182660'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:19:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-87393dd9-ddb4-4529-b7ac-544f01288832 tempest-ProjectReaderTests-1354926172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-87393dd9-ddb4-4529-b7ac-544f01288832 tempest-ProjectReaderTests-1354926172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:47 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-87393dd9-ddb4-4529-b7ac-544f01288832 tempest-ProjectReaderTests-1354926172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:47 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-87393dd9-ddb4-4529-b7ac-544f01288832 tempest-ProjectReaderTests-1354926172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-87393dd9-ddb4-4529-b7ac-544f01288832 tempest-ProjectReaderTests-1354926172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-87393dd9-ddb4-4529-b7ac-544f01288832 tempest-ProjectReaderTests-1354926172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:47 devstack sudo[103348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:19:47 devstack sudo[103348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:47 devstack sudo[103348]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-87393dd9-ddb4-4529-b7ac-544f01288832 tempest-ProjectReaderTests-1354926172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.277s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:47 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-87393dd9-ddb4-4529-b7ac-544f01288832 tempest-ProjectReaderTests-1354926172 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:19:47 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-87393dd9-ddb4-4529-b7ac-544f01288832 tempest-ProjectReaderTests-1354926172 None] Deleted volume successfully. Jul 21 02:19:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-87393dd9-ddb4-4529-b7ac-544f01288832 tempest-ProjectReaderTests-1354926172 None] Lock "cinder-8e9c6be6-8f2b-437a-9e26-f0c01aaea292-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:48 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:19:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] Flow 'volume_create_manager' (bd0ef705-28c1-4ed7-86f5-f0e6dc49f15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:19:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd890950-4056-4abc-a7d3-77d6d149a543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd890950-4056-4abc-a7d3-77d6d149a543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1627641049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ac30b4f-5d3d-46a0-9faa-7ea1ae4326f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a5f27e40cf49528622399d741236d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:19:48Z,use_quota=True,user_id='15ea809e45fa4a16af183de982b12565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (316215fe-8647-43b3-baca-dbef2d65d7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (316215fe-8647-43b3-baca-dbef2d65d7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (476d47f1-202f-4052-923f-45d9127be35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (476d47f1-202f-4052-923f-45d9127be35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ac30b4f-5d3d-46a0-9faa-7ea1ae4326f5', 'volume_name': 'volume-9ac30b4f-5d3d-46a0-9faa-7ea1ae4326f5', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b281819b-f7be-48d6-9557-52806b858a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b281819b-f7be-48d6-9557-52806b858a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35cf1401-2e58-401f-b0fe-dd670f1c5acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:48 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] Volume 9ac30b4f-5d3d-46a0-9faa-7ea1ae4326f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ac30b4f-5d3d-46a0-9faa-7ea1ae4326f5', 'volume_size': 1} Jul 21 02:19:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1627641049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ac30b4f-5d3d-46a0-9faa-7ea1ae4326f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a5f27e40cf49528622399d741236d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:19:48Z,use_quota=True,user_id='15ea809e45fa4a16af183de982b12565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:19:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] Creating volume 9ac30b4f-5d3d-46a0-9faa-7ea1ae4326f5 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:19:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:19:48 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:19:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9ac30b4f-5d3d-46a0-9faa-7ea1ae4326f5 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:48 devstack sudo[103367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9ac30b4f-5d3d-46a0-9faa-7ea1ae4326f5 1073741824 Jul 21 02:19:48 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:48 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:19:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:48 devstack sudo[103379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:19:48 devstack sudo[103379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:49 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9ac30b4f-5d3d-46a0-9faa-7ea1ae4326f5 1073741824" returned: 0 in 0.525s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9ac30b4f-5d3d-46a0-9faa-7ea1ae4326f5 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:49 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9ac30b4f-5d3d-46a0-9faa-7ea1ae4326f5 Jul 21 02:19:49 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:49 devstack sudo[103379]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.331s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:49 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:19:49 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager._thread_info {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:19:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread count: 28 {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 02:19:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread info: [<_MainThread(MainThread, started 135786703114368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 02:19:49 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9ac30b4f-5d3d-46a0-9faa-7ea1ae4326f5" returned: 0 in 0.359s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:19:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35cf1401-2e58-401f-b0fe-dd670f1c5acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ac30b4f-5d3d-46a0-9faa-7ea1ae4326f5', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e2a036-a0cd-44a9-a14f-c7bf1cfb0ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:49 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] Volume volume-9ac30b4f-5d3d-46a0-9faa-7ea1ae4326f5 (9ac30b4f-5d3d-46a0-9faa-7ea1ae4326f5): created successfully Jul 21 02:19:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e2a036-a0cd-44a9-a14f-c7bf1cfb0ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] Flow 'volume_create_manager' (bd0ef705-28c1-4ed7-86f5-f0e6dc49f15a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:19:49 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-00708891-cfb7-4aab-8472-8a233f9d0bdd tempest-ProjectReaderTests-1354926172 None] Created volume successfully. Jul 21 02:19:49 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-677f6040-76e6-4f67-8836-dc6dd6026baa req-6c1275e9-d3d1-4a29-9c82-fa89bb22c9ab tempest-TestInstancesWithCinderVolumes-1617127660 None] Terminate volume connection completed successfully. Jul 21 02:19:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-677f6040-76e6-4f67-8836-dc6dd6026baa req-6c1275e9-d3d1-4a29-9c82-fa89bb22c9ab tempest-TestInstancesWithCinderVolumes-1617127660 None] Deleting attachment 3cb46e21-a7ed-46ba-ad68-4e8650163bc1. {{(pid=87566) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] Flow 'volume_create_manager' (c3ba7511-cb1c-41fa-840e-aac404e9e08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3992f59-2359-4cf9-97f5-0e14b4aefb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ef5356f8-54c1-49ed-8f79-9fb0a428d441 tempest-TestInstancesWithCinderVolumes-1617127660 None] Acquiring lock "cinder-b10d0d16-be6c-4518-9b86-2e34daea0115-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-06913728-9147-48d2-a130-4e5279614335 tempest-ProjectReaderTests-1354926172 None] Acquiring lock "cinder-9ac30b4f-5d3d-46a0-9faa-7ea1ae4326f5-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3992f59-2359-4cf9-97f5-0e14b4aefb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a79029e9-618a-4386-a159-ae042195679f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57871f6f6d34566acc309f5dd3d79c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:19:50Z,use_quota=True,user_id='470098c4b834442ebe03d417536103be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb89c19-c579-4cf4-bbfd-f41fb9e48ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb89c19-c579-4cf4-bbfd-f41fb9e48ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94828479-a5da-406f-82a3-250cf7f9e62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94828479-a5da-406f-82a3-250cf7f9e62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a79029e9-618a-4386-a159-ae042195679f', 'volume_name': 'volume-a79029e9-618a-4386-a159-ae042195679f', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c2558f4-6f5d-48cb-90af-dd0f227f66dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c2558f4-6f5d-48cb-90af-dd0f227f66dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3dcff90-850f-4c18-b4bd-4eb61ef78368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:50 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] Volume a79029e9-618a-4386-a159-ae042195679f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a79029e9-618a-4386-a159-ae042195679f', 'volume_size': 1} Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a79029e9-618a-4386-a159-ae042195679f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57871f6f6d34566acc309f5dd3d79c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:19:50Z,use_quota=True,user_id='470098c4b834442ebe03d417536103be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] Creating volume a79029e9-618a-4386-a159-ae042195679f {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:19:50 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79029e9-618a-4386-a159-ae042195679f 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-06913728-9147-48d2-a130-4e5279614335 tempest-ProjectReaderTests-1354926172 None] Lock "cinder-9ac30b4f-5d3d-46a0-9faa-7ea1ae4326f5-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:50 devstack sudo[103393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79029e9-618a-4386-a159-ae042195679f 1073741824 Jul 21 02:19:50 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ef5356f8-54c1-49ed-8f79-9fb0a428d441 tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "cinder-b10d0d16-be6c-4518-9b86-2e34daea0115-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-06913728-9147-48d2-a130-4e5279614335 tempest-ProjectReaderTests-1354926172 None] Acquiring lock "cinder-quobyte-9ac30b4f-5d3d-46a0-9faa-7ea1ae4326f5" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ef5356f8-54c1-49ed-8f79-9fb0a428d441 tempest-TestInstancesWithCinderVolumes-1617127660 None] Acquiring lock "cinder-quobyte-b10d0d16-be6c-4518-9b86-2e34daea0115" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ef5356f8-54c1-49ed-8f79-9fb0a428d441 tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "cinder-quobyte-b10d0d16-be6c-4518-9b86-2e34daea0115" acquired by "delete_volume" :: waited 0.019s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-06913728-9147-48d2-a130-4e5279614335 tempest-ProjectReaderTests-1354926172 None] Lock "cinder-quobyte-9ac30b4f-5d3d-46a0-9faa-7ea1ae4326f5" acquired by "delete_volume" :: waited 0.037s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafa1013-535c-4eea-b783-d8f48a91f01d]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ef5356f8-54c1-49ed-8f79-9fb0a428d441 tempest-TestInstancesWithCinderVolumes-1617127660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b10d0d16-be6c-4518-9b86-2e34daea0115 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf1728d-2858-4eb3-81cc-2d6f53a60656]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:19:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-06913728-9147-48d2-a130-4e5279614335 tempest-ProjectReaderTests-1354926172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9ac30b4f-5d3d-46a0-9faa-7ea1ae4326f5 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:50 devstack sudo[103395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b10d0d16-be6c-4518-9b86-2e34daea0115 Jul 21 02:19:50 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:50 devstack sudo[103396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9ac30b4f-5d3d-46a0-9faa-7ea1ae4326f5 Jul 21 02:19:50 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:51 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79029e9-618a-4386-a159-ae042195679f 1073741824" returned: 0 in 0.481s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79029e9-618a-4386-a159-ae042195679f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:51 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ef5356f8-54c1-49ed-8f79-9fb0a428d441 tempest-TestInstancesWithCinderVolumes-1617127660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b10d0d16-be6c-4518-9b86-2e34daea0115" returned: 0 in 0.415s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ef5356f8-54c1-49ed-8f79-9fb0a428d441 tempest-TestInstancesWithCinderVolumes-1617127660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b10d0d16-be6c-4518-9b86-2e34daea0115 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:51 devstack sudo[103406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79029e9-618a-4386-a159-ae042195679f Jul 21 02:19:51 devstack sudo[103406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:51 devstack sudo[103409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b10d0d16-be6c-4518-9b86-2e34daea0115 Jul 21 02:19:51 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:51 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-06913728-9147-48d2-a130-4e5279614335 tempest-ProjectReaderTests-1354926172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9ac30b4f-5d3d-46a0-9faa-7ea1ae4326f5" returned: 0 in 0.501s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-06913728-9147-48d2-a130-4e5279614335 tempest-ProjectReaderTests-1354926172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9ac30b4f-5d3d-46a0-9faa-7ea1ae4326f5 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:51 devstack sudo[103413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9ac30b4f-5d3d-46a0-9faa-7ea1ae4326f5 Jul 21 02:19:51 devstack sudo[103413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:51 devstack sudo[103406]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79029e9-618a-4386-a159-ae042195679f" returned: 0 in 0.299s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3dcff90-850f-4c18-b4bd-4eb61ef78368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a79029e9-618a-4386-a159-ae042195679f', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dccf83c1-3fb2-4bdf-97eb-ccdf3d20f32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:51 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] Volume volume-a79029e9-618a-4386-a159-ae042195679f (a79029e9-618a-4386-a159-ae042195679f): created successfully Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dccf83c1-3fb2-4bdf-97eb-ccdf3d20f32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] Flow 'volume_create_manager' (c3ba7511-cb1c-41fa-840e-aac404e9e08d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:19:51 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-fddcb6fe-68c5-4d61-b31b-ab60b38fad5c tempest-CinderUnicodeTest-1597800940 None] Created volume successfully. Jul 21 02:19:51 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ef5356f8-54c1-49ed-8f79-9fb0a428d441 tempest-TestInstancesWithCinderVolumes-1617127660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b10d0d16-be6c-4518-9b86-2e34daea0115" returned: 0 in 0.387s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ef5356f8-54c1-49ed-8f79-9fb0a428d441 tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "cinder-quobyte-b10d0d16-be6c-4518-9b86-2e34daea0115" released by "delete_volume" :: held 0.851s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:51 devstack sudo[103413]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-06913728-9147-48d2-a130-4e5279614335 tempest-ProjectReaderTests-1354926172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-9ac30b4f-5d3d-46a0-9faa-7ea1ae4326f5" returned: 0 in 0.319s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-06913728-9147-48d2-a130-4e5279614335 tempest-ProjectReaderTests-1354926172 None] Lock "cinder-quobyte-9ac30b4f-5d3d-46a0-9faa-7ea1ae4326f5" released by "delete_volume" :: held 0.869s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:51 devstack cinder-volume[87566]: WARNING cinder.quota [None req-ef5356f8-54c1-49ed-8f79-9fb0a428d441 tempest-TestInstancesWithCinderVolumes-1617127660 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1063778222-1529892852 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1063778222-1529892852, it is now deprecated. Please use the default quota class for default quota. Jul 21 02:19:51 devstack cinder-volume[87566]: WARNING cinder.quota [None req-ef5356f8-54c1-49ed-8f79-9fb0a428d441 tempest-TestInstancesWithCinderVolumes-1617127660 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1063778222-1529892852 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1063778222-1529892852, it is now deprecated. Please use the default quota class for default quota. Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-ef5356f8-54c1-49ed-8f79-9fb0a428d441 tempest-TestInstancesWithCinderVolumes-1617127660 None] Created reservations ['3ca94fb5-492c-4c59-a4b5-0f5cd892ec07', '3b3b135e-7886-49c2-8da8-32b31f9ff3b6', 'df62d4ec-e92e-46c6-b574-43cafc30a6a4', '61454e0f-9c79-4c32-abc5-b12a5696e1c7'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-06913728-9147-48d2-a130-4e5279614335 tempest-ProjectReaderTests-1354926172 None] Created reservations ['473ee3ee-ae3f-4942-8f7a-a9e3ef0dabe5', 'c2edd8f2-1bcc-427e-bc27-c1855ce42bae', 'e5053418-2167-428a-b630-49a26ccea2ef', '7d9f078c-e3dc-4643-8184-3619775ea557'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ef5356f8-54c1-49ed-8f79-9fb0a428d441 tempest-TestInstancesWithCinderVolumes-1617127660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ef5356f8-54c1-49ed-8f79-9fb0a428d441 tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ef5356f8-54c1-49ed-8f79-9fb0a428d441 tempest-TestInstancesWithCinderVolumes-1617127660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ef5356f8-54c1-49ed-8f79-9fb0a428d441 tempest-TestInstancesWithCinderVolumes-1617127660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ef5356f8-54c1-49ed-8f79-9fb0a428d441 tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ef5356f8-54c1-49ed-8f79-9fb0a428d441 tempest-TestInstancesWithCinderVolumes-1617127660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:51 devstack sudo[103418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:19:51 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-06913728-9147-48d2-a130-4e5279614335 tempest-ProjectReaderTests-1354926172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-06913728-9147-48d2-a130-4e5279614335 tempest-ProjectReaderTests-1354926172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-06913728-9147-48d2-a130-4e5279614335 tempest-ProjectReaderTests-1354926172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-06913728-9147-48d2-a130-4e5279614335 tempest-ProjectReaderTests-1354926172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-06913728-9147-48d2-a130-4e5279614335 tempest-ProjectReaderTests-1354926172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-06913728-9147-48d2-a130-4e5279614335 tempest-ProjectReaderTests-1354926172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:51 devstack sudo[103420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:19:51 devstack sudo[103420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:51 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ef5356f8-54c1-49ed-8f79-9fb0a428d441 tempest-TestInstancesWithCinderVolumes-1617127660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.266s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-ef5356f8-54c1-49ed-8f79-9fb0a428d441 tempest-TestInstancesWithCinderVolumes-1617127660 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:19:51 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-ef5356f8-54c1-49ed-8f79-9fb0a428d441 tempest-TestInstancesWithCinderVolumes-1617127660 None] Deleted volume successfully. Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ef5356f8-54c1-49ed-8f79-9fb0a428d441 tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "cinder-b10d0d16-be6c-4518-9b86-2e34daea0115-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:51 devstack sudo[103420]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-06913728-9147-48d2-a130-4e5279614335 tempest-ProjectReaderTests-1354926172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.261s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:51 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-06913728-9147-48d2-a130-4e5279614335 tempest-ProjectReaderTests-1354926172 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:19:51 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-06913728-9147-48d2-a130-4e5279614335 tempest-ProjectReaderTests-1354926172 None] Deleted volume successfully. Jul 21 02:19:52 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-06913728-9147-48d2-a130-4e5279614335 tempest-ProjectReaderTests-1354926172 None] Lock "cinder-9ac30b4f-5d3d-46a0-9faa-7ea1ae4326f5-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:53 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:19:53 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] Flow 'volume_create_manager' (c9a5aa63-2c37-4a8a-9d3b-1dde233d357f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:19:53 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c64cd23-7f31-4151-b8fb-78ad297b1d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:53 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c64cd23-7f31-4151-b8fb-78ad297b1d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:19:53Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1078442919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b989e0d4-7553-4aa8-a5ca-92c407e319c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57871f6f6d34566acc309f5dd3d79c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:19:53Z,use_quota=True,user_id='470098c4b834442ebe03d417536103be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:53 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80f54fba-ebf4-4732-bf05-cf5f800176aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:53 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80f54fba-ebf4-4732-bf05-cf5f800176aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:53 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c9ad4d3-0319-4f89-9a72-960e2a0a305b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:53 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c9ad4d3-0319-4f89-9a72-960e2a0a305b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b989e0d4-7553-4aa8-a5ca-92c407e319c8', 'volume_name': 'volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:53 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35290e5d-c7b0-4c64-8b7a-0aa8a94f2586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:53 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35290e5d-c7b0-4c64-8b7a-0aa8a94f2586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:53 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2ded7e7-f09e-477a-a0b6-b11dd3dedc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:53 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] Volume b989e0d4-7553-4aa8-a5ca-92c407e319c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8', 'volume_size': 1} Jul 21 02:19:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:19:53Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1078442919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b989e0d4-7553-4aa8-a5ca-92c407e319c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57871f6f6d34566acc309f5dd3d79c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:19:53Z,use_quota=True,user_id='470098c4b834442ebe03d417536103be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:19:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] Creating volume b989e0d4-7553-4aa8-a5ca-92c407e319c8 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:19:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:19:53 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:19:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:53 devstack sudo[103440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8 1073741824 Jul 21 02:19:53 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:53 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8 1073741824" returned: 0 in 0.469s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:53 devstack sudo[103452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8 Jul 21 02:19:53 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:54 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8" returned: 0 in 0.319s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:54 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:19:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2ded7e7-f09e-477a-a0b6-b11dd3dedc01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd1d262-fe24-4166-af0d-e5f999cf0ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:19:54 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] Volume volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8 (b989e0d4-7553-4aa8-a5ca-92c407e319c8): created successfully Jul 21 02:19:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd1d262-fe24-4166-af0d-e5f999cf0ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:19:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] Flow 'volume_create_manager' (c9a5aa63-2c37-4a8a-9d3b-1dde233d357f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:19:54 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-4d25874c-1aff-4570-8210-ec9eea2557e8 tempest-CinderUnicodeTest-1597800940 None] Created volume successfully. Jul 21 02:19:54 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-23b9becf-b900-4971-960e-2f60d0ab75bd req-aab4fcc4-e5ad-4143-b317-1b7f5349970d tempest-TestInstancesWithCinderVolumes-1617127660 None] Terminate volume connection completed successfully. Jul 21 02:19:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-23b9becf-b900-4971-960e-2f60d0ab75bd req-aab4fcc4-e5ad-4143-b317-1b7f5349970d tempest-TestInstancesWithCinderVolumes-1617127660 None] Deleting attachment 7d7218e1-f288-46ef-809a-064fa3083cdc. {{(pid=87566) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 02:19:55 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-222ae175-70fb-4231-bdd6-8ccdbe42a205 tempest-TestInstancesWithCinderVolumes-1617127660 None] Acquiring lock "cinder-b2726e0e-ee3e-4736-b07d-eb98066a5c04-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:55 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-222ae175-70fb-4231-bdd6-8ccdbe42a205 tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "cinder-b2726e0e-ee3e-4736-b07d-eb98066a5c04-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:55 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-222ae175-70fb-4231-bdd6-8ccdbe42a205 tempest-TestInstancesWithCinderVolumes-1617127660 None] Acquiring lock "cinder-quobyte-b2726e0e-ee3e-4736-b07d-eb98066a5c04" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:55 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-222ae175-70fb-4231-bdd6-8ccdbe42a205 tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "cinder-quobyte-b2726e0e-ee3e-4736-b07d-eb98066a5c04" acquired by "delete_volume" :: waited 0.023s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:55 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a51d60e-610a-4027-a79a-82886cf19dc2]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:19:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-222ae175-70fb-4231-bdd6-8ccdbe42a205 tempest-TestInstancesWithCinderVolumes-1617127660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b2726e0e-ee3e-4736-b07d-eb98066a5c04 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:55 devstack sudo[103491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b2726e0e-ee3e-4736-b07d-eb98066a5c04 Jul 21 02:19:55 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3443d75f-47ef-4ebe-99d7-9a4833776740 tempest-CinderUnicodeTest-1597800940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3443d75f-47ef-4ebe-99d7-9a4833776740 tempest-CinderUnicodeTest-1597800940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-3443d75f-47ef-4ebe-99d7-9a4833776740 tempest-CinderUnicodeTest-1597800940 None] Creating offline snapshot cd8a8c63-543f-40d3-a1e6-911c8017c9aa of volume b989e0d4-7553-4aa8-a5ca-92c407e319c8 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:19:55 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc690089-43c9-4cdc-b3a8-4e9c9c0480f1]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:19:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3443d75f-47ef-4ebe-99d7-9a4833776740 tempest-CinderUnicodeTest-1597800940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:55 devstack sudo[103495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8 Jul 21 02:19:55 devstack sudo[103495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:55 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-222ae175-70fb-4231-bdd6-8ccdbe42a205 tempest-TestInstancesWithCinderVolumes-1617127660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b2726e0e-ee3e-4736-b07d-eb98066a5c04" returned: 0 in 0.487s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-222ae175-70fb-4231-bdd6-8ccdbe42a205 tempest-TestInstancesWithCinderVolumes-1617127660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b2726e0e-ee3e-4736-b07d-eb98066a5c04 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:55 devstack sudo[103500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b2726e0e-ee3e-4736-b07d-eb98066a5c04 Jul 21 02:19:55 devstack sudo[103500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:55 devstack sudo[103495]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3443d75f-47ef-4ebe-99d7-9a4833776740 tempest-CinderUnicodeTest-1597800940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8" returned: 0 in 0.427s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3443d75f-47ef-4ebe-99d7-9a4833776740 tempest-CinderUnicodeTest-1597800940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8.cd8a8c63-543f-40d3-a1e6-911c8017c9aa 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:55 devstack sudo[103500]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-222ae175-70fb-4231-bdd6-8ccdbe42a205 tempest-TestInstancesWithCinderVolumes-1617127660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b2726e0e-ee3e-4736-b07d-eb98066a5c04" returned: 0 in 0.271s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:56 devstack sudo[103506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8.cd8a8c63-543f-40d3-a1e6-911c8017c9aa 1G Jul 21 02:19:56 devstack sudo[103506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:56 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-222ae175-70fb-4231-bdd6-8ccdbe42a205 tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "cinder-quobyte-b2726e0e-ee3e-4736-b07d-eb98066a5c04" released by "delete_volume" :: held 0.814s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:56 devstack cinder-volume[87566]: WARNING cinder.quota [None req-222ae175-70fb-4231-bdd6-8ccdbe42a205 tempest-TestInstancesWithCinderVolumes-1617127660 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1538091611-1946078479 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1538091611-1946078479, it is now deprecated. Please use the default quota class for default quota. Jul 21 02:19:56 devstack cinder-volume[87566]: WARNING cinder.quota [None req-222ae175-70fb-4231-bdd6-8ccdbe42a205 tempest-TestInstancesWithCinderVolumes-1617127660 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1538091611-1946078479 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1538091611-1946078479, it is now deprecated. Please use the default quota class for default quota. Jul 21 02:19:56 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-222ae175-70fb-4231-bdd6-8ccdbe42a205 tempest-TestInstancesWithCinderVolumes-1617127660 None] Created reservations ['10decb89-5e0d-4dfd-b9eb-42ad1ef88689', 'b92811a6-eb37-44d1-804f-300b51a9fa7a', 'e027b307-1506-43e6-b296-ab9026c114ad', '1b37ee80-faa2-4982-8503-4e9dfdb2b72c'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:19:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-222ae175-70fb-4231-bdd6-8ccdbe42a205 tempest-TestInstancesWithCinderVolumes-1617127660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:19:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-222ae175-70fb-4231-bdd6-8ccdbe42a205 tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:19:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-222ae175-70fb-4231-bdd6-8ccdbe42a205 tempest-TestInstancesWithCinderVolumes-1617127660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:19:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-222ae175-70fb-4231-bdd6-8ccdbe42a205 tempest-TestInstancesWithCinderVolumes-1617127660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:19:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-222ae175-70fb-4231-bdd6-8ccdbe42a205 tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-222ae175-70fb-4231-bdd6-8ccdbe42a205 tempest-TestInstancesWithCinderVolumes-1617127660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:56 devstack sudo[103508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:19:56 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:56 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-222ae175-70fb-4231-bdd6-8ccdbe42a205 tempest-TestInstancesWithCinderVolumes-1617127660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.328s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:56 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-222ae175-70fb-4231-bdd6-8ccdbe42a205 tempest-TestInstancesWithCinderVolumes-1617127660 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:19:56 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-222ae175-70fb-4231-bdd6-8ccdbe42a205 tempest-TestInstancesWithCinderVolumes-1617127660 None] Deleted volume successfully. Jul 21 02:19:56 devstack sudo[103506]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3443d75f-47ef-4ebe-99d7-9a4833776740 tempest-CinderUnicodeTest-1597800940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8.cd8a8c63-543f-40d3-a1e6-911c8017c9aa 1G" returned: 0 in 0.511s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3443d75f-47ef-4ebe-99d7-9a4833776740 tempest-CinderUnicodeTest-1597800940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8.cd8a8c63-543f-40d3-a1e6-911c8017c9aa {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:56 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-222ae175-70fb-4231-bdd6-8ccdbe42a205 tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "cinder-b2726e0e-ee3e-4736-b07d-eb98066a5c04-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:19:56 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8.cd8a8c63-543f-40d3-a1e6-911c8017c9aa Jul 21 02:19:56 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:56 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3443d75f-47ef-4ebe-99d7-9a4833776740 tempest-CinderUnicodeTest-1597800940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8.cd8a8c63-543f-40d3-a1e6-911c8017c9aa" returned: 0 in 0.328s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:56 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-3443d75f-47ef-4ebe-99d7-9a4833776740 tempest-CinderUnicodeTest-1597800940 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8.cd8a8c63-543f-40d3-a1e6-911c8017c9aa is being set with open permissions: ugo+rw Jul 21 02:19:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3443d75f-47ef-4ebe-99d7-9a4833776740 tempest-CinderUnicodeTest-1597800940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8.cd8a8c63-543f-40d3-a1e6-911c8017c9aa {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:56 devstack sudo[103521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8.cd8a8c63-543f-40d3-a1e6-911c8017c9aa Jul 21 02:19:56 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:57 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3443d75f-47ef-4ebe-99d7-9a4833776740 tempest-CinderUnicodeTest-1597800940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8.cd8a8c63-543f-40d3-a1e6-911c8017c9aa" returned: 0 in 0.271s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3443d75f-47ef-4ebe-99d7-9a4833776740 tempest-CinderUnicodeTest-1597800940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:57 devstack sudo[103524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8.info Jul 21 02:19:57 devstack sudo[103524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:57 devstack sudo[103524]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3443d75f-47ef-4ebe-99d7-9a4833776740 tempest-CinderUnicodeTest-1597800940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8.info" returned: 0 in 0.263s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:57 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-3443d75f-47ef-4ebe-99d7-9a4833776740 tempest-CinderUnicodeTest-1597800940 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8.info is being set with open permissions: ugo+rw Jul 21 02:19:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3443d75f-47ef-4ebe-99d7-9a4833776740 tempest-CinderUnicodeTest-1597800940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:57 devstack sudo[103527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8.info Jul 21 02:19:57 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:57 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3443d75f-47ef-4ebe-99d7-9a4833776740 tempest-CinderUnicodeTest-1597800940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8.info" returned: 0 in 0.271s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3443d75f-47ef-4ebe-99d7-9a4833776740 tempest-CinderUnicodeTest-1597800940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.190s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:19:57 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-3443d75f-47ef-4ebe-99d7-9a4833776740 tempest-CinderUnicodeTest-1597800940 None] Create snapshot completed successfully Jul 21 02:19:58 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f407a54a-c677-406c-8624-7874f2431cb8 tempest-CinderUnicodeTest-1597800940 None] Acquiring lock "cinder-cd8a8c63-543f-40d3-a1e6-911c8017c9aa-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:58 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f407a54a-c677-406c-8624-7874f2431cb8 tempest-CinderUnicodeTest-1597800940 None] Lock "cinder-cd8a8c63-543f-40d3-a1e6-911c8017c9aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:58 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f407a54a-c677-406c-8624-7874f2431cb8 tempest-CinderUnicodeTest-1597800940 None] Acquiring lock "cinder-quobyte-b989e0d4-7553-4aa8-a5ca-92c407e319c8" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:58 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f407a54a-c677-406c-8624-7874f2431cb8 tempest-CinderUnicodeTest-1597800940 None] Lock "cinder-quobyte-b989e0d4-7553-4aa8-a5ca-92c407e319c8" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:58 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f407a54a-c677-406c-8624-7874f2431cb8 tempest-CinderUnicodeTest-1597800940 None] Acquiring lock "cinder-quobyte-cd8a8c63-543f-40d3-a1e6-911c8017c9aa" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:19:58 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f407a54a-c677-406c-8624-7874f2431cb8 tempest-CinderUnicodeTest-1597800940 None] Lock "cinder-quobyte-cd8a8c63-543f-40d3-a1e6-911c8017c9aa" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:19:58 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-f407a54a-c677-406c-8624-7874f2431cb8 tempest-CinderUnicodeTest-1597800940 None] Deleting offline snapshot cd8a8c63-543f-40d3-a1e6-911c8017c9aa of volume b989e0d4-7553-4aa8-a5ca-92c407e319c8 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:19:58 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-f407a54a-c677-406c-8624-7874f2431cb8 tempest-CinderUnicodeTest-1597800940 None] snapshot_file for this snap is: volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8.cd8a8c63-543f-40d3-a1e6-911c8017c9aa {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:19:58 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c07693f-7116-45d9-a476-9fdbf3085c0d]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:19:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f407a54a-c677-406c-8624-7874f2431cb8 tempest-CinderUnicodeTest-1597800940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8.cd8a8c63-543f-40d3-a1e6-911c8017c9aa {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:58 devstack sudo[103553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8.cd8a8c63-543f-40d3-a1e6-911c8017c9aa Jul 21 02:19:58 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:59 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f407a54a-c677-406c-8624-7874f2431cb8 tempest-CinderUnicodeTest-1597800940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8.cd8a8c63-543f-40d3-a1e6-911c8017c9aa" returned: 0 in 0.394s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:59 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-f407a54a-c677-406c-8624-7874f2431cb8 tempest-CinderUnicodeTest-1597800940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:19:59 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bbc21b-e195-4bd0-96c3-0859bea5c3b3]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:19:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f407a54a-c677-406c-8624-7874f2431cb8 tempest-CinderUnicodeTest-1597800940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:59 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-15ab7f13-8501-4f7b-ae44-7064f7259f38 req-cfd66cca-7bac-4b8b-9b7d-3a84650dc143 tempest-TestInstancesWithCinderVolumes-1617127660 None] Terminate volume connection completed successfully. Jul 21 02:19:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-15ab7f13-8501-4f7b-ae44-7064f7259f38 req-cfd66cca-7bac-4b8b-9b7d-3a84650dc143 tempest-TestInstancesWithCinderVolumes-1617127660 None] Deleting attachment c9b49951-fcc3-4756-8a33-63132a492305. {{(pid=87566) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 02:19:59 devstack sudo[103560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8 Jul 21 02:19:59 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:59 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f407a54a-c677-406c-8624-7874f2431cb8 tempest-CinderUnicodeTest-1597800940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8" returned: 0 in 0.364s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f407a54a-c677-406c-8624-7874f2431cb8 tempest-CinderUnicodeTest-1597800940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8.cd8a8c63-543f-40d3-a1e6-911c8017c9aa {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:59 devstack sudo[103566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8.cd8a8c63-543f-40d3-a1e6-911c8017c9aa Jul 21 02:19:59 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:19:59 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root Jul 21 02:19:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f407a54a-c677-406c-8624-7874f2431cb8 tempest-CinderUnicodeTest-1597800940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8.cd8a8c63-543f-40d3-a1e6-911c8017c9aa" returned: 0 in 0.349s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:19:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f407a54a-c677-406c-8624-7874f2431cb8 tempest-CinderUnicodeTest-1597800940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8.cd8a8c63-543f-40d3-a1e6-911c8017c9aa {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:19:59 devstack sudo[103571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8.cd8a8c63-543f-40d3-a1e6-911c8017c9aa Jul 21 02:19:59 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:20:00 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root Jul 21 02:20:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f407a54a-c677-406c-8624-7874f2431cb8 tempest-CinderUnicodeTest-1597800940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8.cd8a8c63-543f-40d3-a1e6-911c8017c9aa" returned: 0 in 0.239s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:20:00 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f407a54a-c677-406c-8624-7874f2431cb8 tempest-CinderUnicodeTest-1597800940 None] Lock "cinder-quobyte-cd8a8c63-543f-40d3-a1e6-911c8017c9aa" released by "_delete_snapshot" :: held 1.464s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:20:00 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f407a54a-c677-406c-8624-7874f2431cb8 tempest-CinderUnicodeTest-1597800940 None] Lock "cinder-quobyte-b989e0d4-7553-4aa8-a5ca-92c407e319c8" released by "delete_snapshot" :: held 1.495s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:20:00 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-f407a54a-c677-406c-8624-7874f2431cb8 tempest-CinderUnicodeTest-1597800940 None] Created reservations ['ab5b0430-025a-4eee-91f3-d288007e1ef3', 'ad4e4fa7-40b5-48d1-8d5a-51973056049b', 'dc797176-2493-43bd-a845-4896b199def9', 'b74053b8-53ed-4655-8119-7f784fe6a413'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:20:00 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f23f96c2-5d5c-4afa-b4e5-bc6ea8fee83e tempest-TestInstancesWithCinderVolumes-1617127660 None] Acquiring lock "cinder-8511555e-c92b-4a45-a9cf-110dd33a60c0-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:20:00 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f23f96c2-5d5c-4afa-b4e5-bc6ea8fee83e tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "cinder-8511555e-c92b-4a45-a9cf-110dd33a60c0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:20:00 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-f407a54a-c677-406c-8624-7874f2431cb8 tempest-CinderUnicodeTest-1597800940 None] Delete snapshot completed successfully. Jul 21 02:20:00 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f23f96c2-5d5c-4afa-b4e5-bc6ea8fee83e tempest-TestInstancesWithCinderVolumes-1617127660 None] Acquiring lock "cinder-quobyte-8511555e-c92b-4a45-a9cf-110dd33a60c0" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:20:00 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f407a54a-c677-406c-8624-7874f2431cb8 tempest-CinderUnicodeTest-1597800940 None] Lock "cinder-cd8a8c63-543f-40d3-a1e6-911c8017c9aa-delete_snapshot" released by "delete_snapshot" :: held 1.660s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:20:00 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f23f96c2-5d5c-4afa-b4e5-bc6ea8fee83e tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "cinder-quobyte-8511555e-c92b-4a45-a9cf-110dd33a60c0" acquired by "delete_volume" :: waited 0.017s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:20:00 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1718e11-b6c9-41b7-afb7-5eed4883bdc7]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:20:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f23f96c2-5d5c-4afa-b4e5-bc6ea8fee83e tempest-TestInstancesWithCinderVolumes-1617127660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8511555e-c92b-4a45-a9cf-110dd33a60c0 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:20:00 devstack sudo[103574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8511555e-c92b-4a45-a9cf-110dd33a60c0 Jul 21 02:20:00 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:20:00 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root Jul 21 02:20:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f23f96c2-5d5c-4afa-b4e5-bc6ea8fee83e tempest-TestInstancesWithCinderVolumes-1617127660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8511555e-c92b-4a45-a9cf-110dd33a60c0" returned: 0 in 0.344s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:20:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f23f96c2-5d5c-4afa-b4e5-bc6ea8fee83e tempest-TestInstancesWithCinderVolumes-1617127660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8511555e-c92b-4a45-a9cf-110dd33a60c0 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:20:00 devstack sudo[103579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8511555e-c92b-4a45-a9cf-110dd33a60c0 Jul 21 02:20:00 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:20:00 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f5be02ab-be3a-47ef-988f-edf0776865ae tempest-CinderUnicodeTest-1597800940 None] Acquiring lock "cinder-b989e0d4-7553-4aa8-a5ca-92c407e319c8-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:20:00 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f5be02ab-be3a-47ef-988f-edf0776865ae tempest-CinderUnicodeTest-1597800940 None] Lock "cinder-b989e0d4-7553-4aa8-a5ca-92c407e319c8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:20:00 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f5be02ab-be3a-47ef-988f-edf0776865ae tempest-CinderUnicodeTest-1597800940 None] Acquiring lock "cinder-quobyte-b989e0d4-7553-4aa8-a5ca-92c407e319c8" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:20:00 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f5be02ab-be3a-47ef-988f-edf0776865ae tempest-CinderUnicodeTest-1597800940 None] Lock "cinder-quobyte-b989e0d4-7553-4aa8-a5ca-92c407e319c8" acquired by "delete_volume" :: waited 0.017s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:20:01 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[03853d21-17ef-45a2-b3c2-1df5f24071cb]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:20:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f5be02ab-be3a-47ef-988f-edf0776865ae tempest-CinderUnicodeTest-1597800940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:20:01 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root Jul 21 02:20:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f23f96c2-5d5c-4afa-b4e5-bc6ea8fee83e tempest-TestInstancesWithCinderVolumes-1617127660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8511555e-c92b-4a45-a9cf-110dd33a60c0" returned: 0 in 0.259s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:20:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f23f96c2-5d5c-4afa-b4e5-bc6ea8fee83e tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "cinder-quobyte-8511555e-c92b-4a45-a9cf-110dd33a60c0" released by "delete_volume" :: held 0.645s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:20:01 devstack cinder-volume[87566]: WARNING cinder.quota [None req-f23f96c2-5d5c-4afa-b4e5-bc6ea8fee83e tempest-TestInstancesWithCinderVolumes-1617127660 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-174766863-1357728744 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-174766863-1357728744, it is now deprecated. Please use the default quota class for default quota. Jul 21 02:20:01 devstack cinder-volume[87566]: WARNING cinder.quota [None req-f23f96c2-5d5c-4afa-b4e5-bc6ea8fee83e tempest-TestInstancesWithCinderVolumes-1617127660 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-174766863-1357728744 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-174766863-1357728744, it is now deprecated. Please use the default quota class for default quota. Jul 21 02:20:01 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-f23f96c2-5d5c-4afa-b4e5-bc6ea8fee83e tempest-TestInstancesWithCinderVolumes-1617127660 None] Created reservations ['75e34e6d-7656-46b6-8d29-6836b080c941', '5581be72-f282-4536-8cc8-08170ed8add7', '0b64ff91-1f78-4ac8-b086-6a8fa50bb24d', '4c1527e2-979a-4495-a8ad-0a0708a2c115'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:20:01 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8 Jul 21 02:20:01 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:20:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f23f96c2-5d5c-4afa-b4e5-bc6ea8fee83e tempest-TestInstancesWithCinderVolumes-1617127660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:20:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f23f96c2-5d5c-4afa-b4e5-bc6ea8fee83e tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:20:01 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f23f96c2-5d5c-4afa-b4e5-bc6ea8fee83e tempest-TestInstancesWithCinderVolumes-1617127660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:20:01 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f23f96c2-5d5c-4afa-b4e5-bc6ea8fee83e tempest-TestInstancesWithCinderVolumes-1617127660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:20:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f23f96c2-5d5c-4afa-b4e5-bc6ea8fee83e tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:20:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f23f96c2-5d5c-4afa-b4e5-bc6ea8fee83e tempest-TestInstancesWithCinderVolumes-1617127660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:20:01 devstack sudo[103584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:20:01 devstack sudo[103584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:20:01 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Jul 21 02:20:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f5be02ab-be3a-47ef-988f-edf0776865ae tempest-CinderUnicodeTest-1597800940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8" returned: 0 in 0.366s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:20:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f5be02ab-be3a-47ef-988f-edf0776865ae tempest-CinderUnicodeTest-1597800940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:20:01 devstack sudo[103590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8 Jul 21 02:20:01 devstack sudo[103590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:20:01 devstack sudo[103584]: pam_unix(sudo:session): session closed for user root Jul 21 02:20:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f23f96c2-5d5c-4afa-b4e5-bc6ea8fee83e tempest-TestInstancesWithCinderVolumes-1617127660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.258s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:20:01 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-f23f96c2-5d5c-4afa-b4e5-bc6ea8fee83e tempest-TestInstancesWithCinderVolumes-1617127660 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:20:01 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-f23f96c2-5d5c-4afa-b4e5-bc6ea8fee83e tempest-TestInstancesWithCinderVolumes-1617127660 None] Deleted volume successfully. Jul 21 02:20:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f23f96c2-5d5c-4afa-b4e5-bc6ea8fee83e tempest-TestInstancesWithCinderVolumes-1617127660 None] Lock "cinder-8511555e-c92b-4a45-a9cf-110dd33a60c0-delete_volume" released by "delete_volume" :: held 1.118s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:20:01 devstack sudo[103590]: pam_unix(sudo:session): session closed for user root Jul 21 02:20:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f5be02ab-be3a-47ef-988f-edf0776865ae tempest-CinderUnicodeTest-1597800940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b989e0d4-7553-4aa8-a5ca-92c407e319c8" returned: 0 in 0.269s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:20:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f5be02ab-be3a-47ef-988f-edf0776865ae tempest-CinderUnicodeTest-1597800940 None] Lock "cinder-quobyte-b989e0d4-7553-4aa8-a5ca-92c407e319c8" released by "delete_volume" :: held 0.694s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:20:01 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-f5be02ab-be3a-47ef-988f-edf0776865ae tempest-CinderUnicodeTest-1597800940 None] Created reservations ['20925ea5-561d-4f92-9210-61497364a2f1', 'dacc90bc-3a29-4cf2-a29e-beb6bd58f90c', '9aaf850e-4bf6-45bb-b01c-5f213075aee0', '72b6a5ce-0c70-41e4-8045-b75c2e5500af'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:20:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f5be02ab-be3a-47ef-988f-edf0776865ae tempest-CinderUnicodeTest-1597800940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:20:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f5be02ab-be3a-47ef-988f-edf0776865ae tempest-CinderUnicodeTest-1597800940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:20:01 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f5be02ab-be3a-47ef-988f-edf0776865ae tempest-CinderUnicodeTest-1597800940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:20:01 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f5be02ab-be3a-47ef-988f-edf0776865ae tempest-CinderUnicodeTest-1597800940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:20:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f5be02ab-be3a-47ef-988f-edf0776865ae tempest-CinderUnicodeTest-1597800940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:20:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f5be02ab-be3a-47ef-988f-edf0776865ae tempest-CinderUnicodeTest-1597800940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:20:01 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:20:01 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:20:02 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Jul 21 02:20:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f5be02ab-be3a-47ef-988f-edf0776865ae tempest-CinderUnicodeTest-1597800940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.240s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:20:02 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-f5be02ab-be3a-47ef-988f-edf0776865ae tempest-CinderUnicodeTest-1597800940 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:20:02 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-f5be02ab-be3a-47ef-988f-edf0776865ae tempest-CinderUnicodeTest-1597800940 None] Deleted volume successfully. Jul 21 02:20:02 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ca786369-3541-419f-a2af-9c7c40fdbe83 tempest-CinderUnicodeTest-1597800940 None] Acquiring lock "cinder-a79029e9-618a-4386-a159-ae042195679f-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:20:02 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f5be02ab-be3a-47ef-988f-edf0776865ae tempest-CinderUnicodeTest-1597800940 None] Lock "cinder-b989e0d4-7553-4aa8-a5ca-92c407e319c8-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:20:02 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ca786369-3541-419f-a2af-9c7c40fdbe83 tempest-CinderUnicodeTest-1597800940 None] Lock "cinder-a79029e9-618a-4386-a159-ae042195679f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:20:02 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ca786369-3541-419f-a2af-9c7c40fdbe83 tempest-CinderUnicodeTest-1597800940 None] Acquiring lock "cinder-quobyte-a79029e9-618a-4386-a159-ae042195679f" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:20:02 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ca786369-3541-419f-a2af-9c7c40fdbe83 tempest-CinderUnicodeTest-1597800940 None] Lock "cinder-quobyte-a79029e9-618a-4386-a159-ae042195679f" acquired by "delete_volume" :: waited 0.016s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:20:02 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7022a6d-cec3-44fb-a555-79c3917a2a4f]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:20:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ca786369-3541-419f-a2af-9c7c40fdbe83 tempest-CinderUnicodeTest-1597800940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79029e9-618a-4386-a159-ae042195679f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:20:02 devstack sudo[103596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79029e9-618a-4386-a159-ae042195679f Jul 21 02:20:02 devstack sudo[103596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:20:02 devstack sudo[103596]: pam_unix(sudo:session): session closed for user root Jul 21 02:20:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ca786369-3541-419f-a2af-9c7c40fdbe83 tempest-CinderUnicodeTest-1597800940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79029e9-618a-4386-a159-ae042195679f" returned: 0 in 0.381s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:20:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ca786369-3541-419f-a2af-9c7c40fdbe83 tempest-CinderUnicodeTest-1597800940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79029e9-618a-4386-a159-ae042195679f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:20:02 devstack sudo[103601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79029e9-618a-4386-a159-ae042195679f Jul 21 02:20:02 devstack sudo[103601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:20:02 devstack sudo[103601]: pam_unix(sudo:session): session closed for user root Jul 21 02:20:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ca786369-3541-419f-a2af-9c7c40fdbe83 tempest-CinderUnicodeTest-1597800940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a79029e9-618a-4386-a159-ae042195679f" returned: 0 in 0.271s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:20:02 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ca786369-3541-419f-a2af-9c7c40fdbe83 tempest-CinderUnicodeTest-1597800940 None] Lock "cinder-quobyte-a79029e9-618a-4386-a159-ae042195679f" released by "delete_volume" :: held 0.704s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:20:02 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-ca786369-3541-419f-a2af-9c7c40fdbe83 tempest-CinderUnicodeTest-1597800940 None] Created reservations ['6c2f47aa-dd67-4e5b-ae33-867a637e31ab', 'd9010be6-2af8-4779-9d2e-b25b1e306e0d', '1e907de2-3565-4e02-b62a-0eff041e412f', 'd3eab711-95d2-48aa-8dbb-623e05f085ce'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:20:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ca786369-3541-419f-a2af-9c7c40fdbe83 tempest-CinderUnicodeTest-1597800940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:20:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ca786369-3541-419f-a2af-9c7c40fdbe83 tempest-CinderUnicodeTest-1597800940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:20:02 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ca786369-3541-419f-a2af-9c7c40fdbe83 tempest-CinderUnicodeTest-1597800940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:20:02 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ca786369-3541-419f-a2af-9c7c40fdbe83 tempest-CinderUnicodeTest-1597800940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:20:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ca786369-3541-419f-a2af-9c7c40fdbe83 tempest-CinderUnicodeTest-1597800940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:20:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ca786369-3541-419f-a2af-9c7c40fdbe83 tempest-CinderUnicodeTest-1597800940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:20:02 devstack sudo[103605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:20:02 devstack sudo[103605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:20:03 devstack sudo[103605]: pam_unix(sudo:session): session closed for user root Jul 21 02:20:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ca786369-3541-419f-a2af-9c7c40fdbe83 tempest-CinderUnicodeTest-1597800940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.269s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:20:03 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-ca786369-3541-419f-a2af-9c7c40fdbe83 tempest-CinderUnicodeTest-1597800940 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:20:03 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-ca786369-3541-419f-a2af-9c7c40fdbe83 tempest-CinderUnicodeTest-1597800940 None] Deleted volume successfully. Jul 21 02:20:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ca786369-3541-419f-a2af-9c7c40fdbe83 tempest-CinderUnicodeTest-1597800940 None] Lock "cinder-a79029e9-618a-4386-a159-ae042195679f-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:20:12 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:UPDATE=216,cinder:SELECT=166,cinder:INSERT=48,cinder:DELETE=10 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:20:13 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=151,cinder:UPDATE=209,cinder:DELETE=25,cinder:INSERT=54 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:20:41 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:20:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] Flow 'volume_create_manager' (6fbebe20-8dce-49a0-9c84-61b7622785f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:20:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693647ce-b9fc-4336-9413-b491a11a84bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:20:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693647ce-b9fc-4336-9413-b491a11a84bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1331110621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f7cff85-98c8-42e8-953f-6b2b0aea5a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50855850ea14aae9cf1fa7373c1a16d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:20:41Z,use_quota=True,user_id='d31597d3a052457b822dc50c5e7f2436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:20:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490eec65-6558-4e4e-9149-9dd6dd223996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:20:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490eec65-6558-4e4e-9149-9dd6dd223996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:20:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (457a8bd4-c3db-473c-a9ec-ba2bff03466d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:20:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (457a8bd4-c3db-473c-a9ec-ba2bff03466d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f7cff85-98c8-42e8-953f-6b2b0aea5a0a', 'volume_name': 'volume-3f7cff85-98c8-42e8-953f-6b2b0aea5a0a', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:20:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a09329b2-32d0-4f24-9576-03fb930b2735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:20:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a09329b2-32d0-4f24-9576-03fb930b2735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:20:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da33eb36-3b56-46de-b718-6dd8f989f6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:20:41 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] Volume 3f7cff85-98c8-42e8-953f-6b2b0aea5a0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f7cff85-98c8-42e8-953f-6b2b0aea5a0a', 'volume_size': 1} Jul 21 02:20:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:20:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:20:41 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1331110621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f7cff85-98c8-42e8-953f-6b2b0aea5a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50855850ea14aae9cf1fa7373c1a16d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:20:41Z,use_quota=True,user_id='d31597d3a052457b822dc50c5e7f2436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:20:41 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] Creating volume 3f7cff85-98c8-42e8-953f-6b2b0aea5a0a {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:20:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:20:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:20:41 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:20:41 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:20:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:20:41 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:20:41 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:20:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3f7cff85-98c8-42e8-953f-6b2b0aea5a0a 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:20:41 devstack sudo[103733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3f7cff85-98c8-42e8-953f-6b2b0aea5a0a 1073741824 Jul 21 02:20:41 devstack sudo[103733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:20:41 devstack sudo[103733]: pam_unix(sudo:session): session closed for user root Jul 21 02:20:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3f7cff85-98c8-42e8-953f-6b2b0aea5a0a 1073741824" returned: 0 in 0.442s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:20:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3f7cff85-98c8-42e8-953f-6b2b0aea5a0a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:20:41 devstack sudo[103738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3f7cff85-98c8-42e8-953f-6b2b0aea5a0a Jul 21 02:20:41 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:20:41 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root Jul 21 02:20:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3f7cff85-98c8-42e8-953f-6b2b0aea5a0a" returned: 0 in 0.247s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:20:41 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:20:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:20:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da33eb36-3b56-46de-b718-6dd8f989f6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f7cff85-98c8-42e8-953f-6b2b0aea5a0a', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:20:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65360520-7dc0-4f67-8b8a-25bd82066665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:20:41 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] Volume volume-3f7cff85-98c8-42e8-953f-6b2b0aea5a0a (3f7cff85-98c8-42e8-953f-6b2b0aea5a0a): created successfully Jul 21 02:20:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65360520-7dc0-4f67-8b8a-25bd82066665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:20:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] Flow 'volume_create_manager' (6fbebe20-8dce-49a0-9c84-61b7622785f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:20:41 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-01736184-2014-4e33-8fd7-e130738127c4 tempest-TestMinimumBasicScenario-127733757 None] Created volume successfully. Jul 21 02:20:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-fa13455d-929b-40a5-b68a-01abc4e6b200 req-12025e60-a18a-46fe-a0a2-e7e11069a49c tempest-TestMinimumBasicScenario-127733757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:20:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-fa13455d-929b-40a5-b68a-01abc4e6b200 req-12025e60-a18a-46fe-a0a2-e7e11069a49c tempest-TestMinimumBasicScenario-127733757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:20:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-fa13455d-929b-40a5-b68a-01abc4e6b200 req-12025e60-a18a-46fe-a0a2-e7e11069a49c tempest-TestMinimumBasicScenario-127733757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:20:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-fa13455d-929b-40a5-b68a-01abc4e6b200 req-12025e60-a18a-46fe-a0a2-e7e11069a49c tempest-TestMinimumBasicScenario-127733757 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea', 'name': 'volume-3f7cff85-98c8-42e8-953f-6b2b0aea5a0a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '315939d9-258e-451b-937d-2e57e6bfe0a8', 'enforce_multipath': True} {{(pid=87566) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 02:20:42 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-fa13455d-929b-40a5-b68a-01abc4e6b200 req-12025e60-a18a-46fe-a0a2-e7e11069a49c tempest-TestMinimumBasicScenario-127733757 None] attachment_update completed successfully. Jul 21 02:20:48 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:20:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:20:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:20:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:20:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:20:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:20:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:20:48 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:20:48 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:20:49 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Jul 21 02:20:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.286s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:20:49 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:20:49 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager._thread_info {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:20:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread count: 28 {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 02:20:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread info: [<_MainThread(MainThread, started 135786703114368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 02:20:52 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:UPDATE=5,cinder:SELECT=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:20:52 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=10,cinder:UPDATE=4 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:21:17 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=1 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:21:17 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:UPDATE=1 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:21:29 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-7b6e364c-d39f-4c98-b667-276b595d78bf req-7c060c9d-cadb-45de-8034-a21bbf9b591e tempest-TestMinimumBasicScenario-127733757 None] Terminate volume connection completed successfully. Jul 21 02:21:29 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-7b6e364c-d39f-4c98-b667-276b595d78bf req-7c060c9d-cadb-45de-8034-a21bbf9b591e tempest-TestMinimumBasicScenario-127733757 None] Deleting attachment 315939d9-258e-451b-937d-2e57e6bfe0a8. {{(pid=87566) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 02:21:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ee717f26-b826-47ca-9ac4-eff21e72749b tempest-TestMinimumBasicScenario-127733757 None] Acquiring lock "cinder-3f7cff85-98c8-42e8-953f-6b2b0aea5a0a-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:21:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ee717f26-b826-47ca-9ac4-eff21e72749b tempest-TestMinimumBasicScenario-127733757 None] Lock "cinder-3f7cff85-98c8-42e8-953f-6b2b0aea5a0a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:21:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ee717f26-b826-47ca-9ac4-eff21e72749b tempest-TestMinimumBasicScenario-127733757 None] Acquiring lock "cinder-quobyte-3f7cff85-98c8-42e8-953f-6b2b0aea5a0a" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:21:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ee717f26-b826-47ca-9ac4-eff21e72749b tempest-TestMinimumBasicScenario-127733757 None] Lock "cinder-quobyte-3f7cff85-98c8-42e8-953f-6b2b0aea5a0a" acquired by "delete_volume" :: waited 0.013s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:21:30 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[732b4d57-dd00-4097-829f-2ad42614ac52]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:21:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ee717f26-b826-47ca-9ac4-eff21e72749b tempest-TestMinimumBasicScenario-127733757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3f7cff85-98c8-42e8-953f-6b2b0aea5a0a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:21:30 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3f7cff85-98c8-42e8-953f-6b2b0aea5a0a Jul 21 02:21:30 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:21:30 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Jul 21 02:21:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ee717f26-b826-47ca-9ac4-eff21e72749b tempest-TestMinimumBasicScenario-127733757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3f7cff85-98c8-42e8-953f-6b2b0aea5a0a" returned: 0 in 0.354s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:21:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ee717f26-b826-47ca-9ac4-eff21e72749b tempest-TestMinimumBasicScenario-127733757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3f7cff85-98c8-42e8-953f-6b2b0aea5a0a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:21:30 devstack sudo[104292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3f7cff85-98c8-42e8-953f-6b2b0aea5a0a Jul 21 02:21:30 devstack sudo[104292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:21:31 devstack sudo[104292]: pam_unix(sudo:session): session closed for user root Jul 21 02:21:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ee717f26-b826-47ca-9ac4-eff21e72749b tempest-TestMinimumBasicScenario-127733757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-3f7cff85-98c8-42e8-953f-6b2b0aea5a0a" returned: 0 in 0.241s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:21:31 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ee717f26-b826-47ca-9ac4-eff21e72749b tempest-TestMinimumBasicScenario-127733757 None] Lock "cinder-quobyte-3f7cff85-98c8-42e8-953f-6b2b0aea5a0a" released by "delete_volume" :: held 0.633s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:21:31 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-ee717f26-b826-47ca-9ac4-eff21e72749b tempest-TestMinimumBasicScenario-127733757 None] Created reservations ['894a7565-c8fe-4ce8-9ff5-55573eaa1dfc', '3be58057-63d8-4d64-b011-6b708a8a55e6', '91326b9a-c025-4e94-81e4-11baf8e18012', '39e6b07c-ecf2-4b3e-8014-25226dd590ed'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:21:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ee717f26-b826-47ca-9ac4-eff21e72749b tempest-TestMinimumBasicScenario-127733757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:21:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ee717f26-b826-47ca-9ac4-eff21e72749b tempest-TestMinimumBasicScenario-127733757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:21:31 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ee717f26-b826-47ca-9ac4-eff21e72749b tempest-TestMinimumBasicScenario-127733757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:21:31 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ee717f26-b826-47ca-9ac4-eff21e72749b tempest-TestMinimumBasicScenario-127733757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:21:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ee717f26-b826-47ca-9ac4-eff21e72749b tempest-TestMinimumBasicScenario-127733757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:21:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ee717f26-b826-47ca-9ac4-eff21e72749b tempest-TestMinimumBasicScenario-127733757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:21:31 devstack sudo[104295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:21:31 devstack sudo[104295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:21:31 devstack sudo[104295]: pam_unix(sudo:session): session closed for user root Jul 21 02:21:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ee717f26-b826-47ca-9ac4-eff21e72749b tempest-TestMinimumBasicScenario-127733757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.245s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:21:31 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-ee717f26-b826-47ca-9ac4-eff21e72749b tempest-TestMinimumBasicScenario-127733757 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:21:31 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-ee717f26-b826-47ca-9ac4-eff21e72749b tempest-TestMinimumBasicScenario-127733757 None] Deleted volume successfully. Jul 21 02:21:31 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ee717f26-b826-47ca-9ac4-eff21e72749b tempest-TestMinimumBasicScenario-127733757 None] Lock "cinder-3f7cff85-98c8-42e8-953f-6b2b0aea5a0a-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:21:41 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=7,cinder:UPDATE=8,cinder:INSERT=1 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:21:41 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:21:48 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:21:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:21:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:21:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:21:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:21:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:21:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:21:48 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:21:48 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:21:49 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Jul 21 02:21:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.239s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:21:49 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:21:49 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager._thread_info {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:21:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread count: 28 {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 02:21:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread info: [<_MainThread(MainThread, started 135786703114368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 02:22:03 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:22:03 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Flow 'volume_create_manager' (44d635c9-a5ee-4750-bc60-c632fe74123e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:22:03 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb6b1ef-84da-4370-b7ac-d77537d0c5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:22:03 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb6b1ef-84da-4370-b7ac-d77537d0c5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1679983670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=269575c0-a96d-4bdc-a323-83614a144a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f99ba14ee4664d0db347a941d2fa6197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:22:04Z,use_quota=True,user_id='872fe501f08442ada3316ebb3cb2ba94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:22:03 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d8e66a-2cac-433b-9db0-d60abd72cacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:22:03 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d8e66a-2cac-433b-9db0-d60abd72cacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:22:03 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (098c22a0-221f-47c9-aea5-67b6d1583064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:22:03 devstack cinder-volume[87566]: DEBUG cinder.image.glance [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Creating Keystone auth plugin from conf {{(pid=87566) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 02:22:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (098c22a0-221f-47c9-aea5-67b6d1583064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '269575c0-a96d-4bdc-a323-83614a144a62', 'volume_name': 'volume-269575c0-a96d-4bdc-a323-83614a144a62', 'volume_size': 1, 'image_id': '5de785ea-426a-4934-a69a-ddf7f2aebea6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5de785ea-426a-4934-a69a-ddf7f2aebea6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a8e154f63094b778a262349ffd9723e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5de785ea-426a-4934-a69a-ddf7f2aebea6', 'created_at': datetime.datetime(2026, 7, 21, 0, 0, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 0, 0, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5de785ea-426a-4934-a69a-ddf7f2aebea6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:22:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (472af928-ca0f-4e47-bfa8-0ea4cad3b295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:22:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (472af928-ca0f-4e47-bfa8-0ea4cad3b295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:22:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73ff0ff7-98e9-4815-a341-1645b0fa4f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:22:04 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Volume 269575c0-a96d-4bdc-a323-83614a144a62: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-269575c0-a96d-4bdc-a323-83614a144a62', 'volume_size': 1, 'image_id': '5de785ea-426a-4934-a69a-ddf7f2aebea6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5de785ea-426a-4934-a69a-ddf7f2aebea6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a8e154f63094b778a262349ffd9723e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5de785ea-426a-4934-a69a-ddf7f2aebea6', 'created_at': datetime.datetime(2026, 7, 21, 0, 0, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 0, 0, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5de785ea-426a-4934-a69a-ddf7f2aebea6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 21 02:22:04 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Trying to clone 269575c0-a96d-4bdc-a323-83614a144a62 from image 5de785ea-426a-4934-a69a-ddf7f2aebea6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5de785ea-426a-4934-a69a-ddf7f2aebea6', 'metadata': {}}]). {{(pid=87566) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 02:22:04 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_zy0k0n56devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87566) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 02:22:04 devstack cinder-volume[87566]: INFO cinder.image.image_utils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Image download 20.69 MB at 20.69 MB/s Jul 21 02:22:04 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb83f159-b350-4c3d-8e23-a00812b60b8f]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:22:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_zy0k0n56devstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:22:04 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_zy0k0n56devstack@QuobyteHD Jul 21 02:22:04 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:22:04 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Jul 21 02:22:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_zy0k0n56devstack@QuobyteHD" returned: 0 in 0.319s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:22:04 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Temporary image 5de785ea-426a-4934-a69a-ddf7f2aebea6 is fetched for user 872fe501f08442ada3316ebb3cb2ba94. {{(pid=87566) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 02:22:04 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a25625-b521-450e-9778-aae8321d6cf4]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:22:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_zy0k0n56devstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:22:05 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_zy0k0n56devstack@QuobyteHD Jul 21 02:22:05 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:22:05 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Jul 21 02:22:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_zy0k0n56devstack@QuobyteHD" returned: 0 in 0.312s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:22:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:22:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:22:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1679983670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=269575c0-a96d-4bdc-a323-83614a144a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f99ba14ee4664d0db347a941d2fa6197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:22:04Z,use_quota=True,user_id='872fe501f08442ada3316ebb3cb2ba94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:22:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Creating volume 269575c0-a96d-4bdc-a323-83614a144a62 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:22:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:22:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:22:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:22:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:22:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:22:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:22:05 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:22:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-269575c0-a96d-4bdc-a323-83614a144a62 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:22:05 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-269575c0-a96d-4bdc-a323-83614a144a62 1073741824 Jul 21 02:22:05 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:22:05 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Jul 21 02:22:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-269575c0-a96d-4bdc-a323-83614a144a62 1073741824" returned: 0 in 0.385s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:22:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-269575c0-a96d-4bdc-a323-83614a144a62 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:22:05 devstack sudo[104393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-269575c0-a96d-4bdc-a323-83614a144a62 Jul 21 02:22:05 devstack sudo[104393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:22:05 devstack sudo[104393]: pam_unix(sudo:session): session closed for user root Jul 21 02:22:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-269575c0-a96d-4bdc-a323-83614a144a62" returned: 0 in 0.236s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:22:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] <== create_volume: return (661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:22:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.664s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:22:05 devstack cinder-volume[87566]: DEBUG cinder.volume.volume_utils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Attempting download of 5de785ea-426a-4934-a69a-ddf7f2aebea6 ((None, [{'url': 'file:///opt/stack/data/glance/images/5de785ea-426a-4934-a69a-ddf7f2aebea6', 'metadata': {}}])) to volume 269575c0-a96d-4bdc-a323-83614a144a62. {{(pid=87566) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 02:22:05 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a08d5f-40b1-49d8-b3ed-5458e0074747]: (4, 'raw') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:22:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5de785ea-426a-4934-a69a-ddf7f2aebea6_p_tgcorq {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:22:06 devstack sudo[104396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5de785ea-426a-4934-a69a-ddf7f2aebea6_p_tgcorq Jul 21 02:22:06 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:22:06 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root Jul 21 02:22:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5de785ea-426a-4934-a69a-ddf7f2aebea6_p_tgcorq" returned: 0 in 0.315s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:22:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5de785ea-426a-4934-a69a-ddf7f2aebea6_p_tgcorq {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:22:06 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5de785ea-426a-4934-a69a-ddf7f2aebea6_p_tgcorq Jul 21 02:22:06 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:22:06 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Jul 21 02:22:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5de785ea-426a-4934-a69a-ddf7f2aebea6_p_tgcorq" returned: 1 in 0.307s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:22:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5de785ea-426a-4934-a69a-ddf7f2aebea6_p_tgcorq' failed. Not Retrying. {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 02:22:06 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac87a8fe-a39b-47c2-b2f6-820f35dd6540]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:22:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_zy0k0n56devstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:22:06 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_zy0k0n56devstack@QuobyteHD Jul 21 02:22:06 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:22:06 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Jul 21 02:22:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_zy0k0n56devstack@QuobyteHD" returned: 0 in 0.316s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:22:06 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] 5de785ea-426a-4934-a69a-ddf7f2aebea6 was qcow2, converting to qcow2 {{(pid=87566) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 02:22:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_zy0k0n56devstack@QuobyteHD /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-269575c0-a96d-4bdc-a323-83614a144a62 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:22:06 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_zy0k0n56devstack@QuobyteHD /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-269575c0-a96d-4bdc-a323-83614a144a62 Jul 21 02:22:06 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:22:08 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Jul 21 02:22:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_zy0k0n56devstack@QuobyteHD /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-269575c0-a96d-4bdc-a323-83614a144a62" returned: 0 in 1.454s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:22:08 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5de785ea-426a-4934-a69a-ddf7f2aebea6_zy0k0n56devstack@QuobyteHD, size 112.00 MB, duration 1.46 sec, destination /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-269575c0-a96d-4bdc-a323-83614a144a62 {{(pid=87566) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 02:22:08 devstack cinder-volume[87566]: INFO cinder.image.image_utils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Converted 112.00 MB image at 76.97 MB/s Jul 21 02:22:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-269575c0-a96d-4bdc-a323-83614a144a62 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:22:08 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-269575c0-a96d-4bdc-a323-83614a144a62 1G Jul 21 02:22:08 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:22:08 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Jul 21 02:22:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-269575c0-a96d-4bdc-a323-83614a144a62 1G" returned: 0 in 0.292s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:22:08 devstack cinder-volume[87566]: DEBUG cinder.volume.volume_utils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Downloaded image 5de785ea-426a-4934-a69a-ddf7f2aebea6 ((None, [{'url': 'file:///opt/stack/data/glance/images/5de785ea-426a-4934-a69a-ddf7f2aebea6', 'metadata': {}}])) to volume 269575c0-a96d-4bdc-a323-83614a144a62 successfully. {{(pid=87566) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 02:22:08 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Temporary image 5de785ea-426a-4934-a69a-ddf7f2aebea6 for user 872fe501f08442ada3316ebb3cb2ba94 is deleted. {{(pid=87566) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 02:22:08 devstack cinder-volume[87566]: DEBUG cinder.volume.volume_utils [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Marking volume 269575c0-a96d-4bdc-a323-83614a144a62 as bootable. {{(pid=87566) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 02:22:08 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Copying metadata from image 5de785ea-426a-4934-a69a-ddf7f2aebea6 to 269575c0-a96d-4bdc-a323-83614a144a62. {{(pid=87566) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 02:22:08 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Creating volume glance metadata for volume 269575c0-a96d-4bdc-a323-83614a144a62 backed by image 5de785ea-426a-4934-a69a-ddf7f2aebea6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5de785ea-426a-4934-a69a-ddf7f2aebea6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87566) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 02:22:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73ff0ff7-98e9-4815-a341-1645b0fa4f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-269575c0-a96d-4bdc-a323-83614a144a62', 'volume_size': 1, 'image_id': '5de785ea-426a-4934-a69a-ddf7f2aebea6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5de785ea-426a-4934-a69a-ddf7f2aebea6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a8e154f63094b778a262349ffd9723e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5de785ea-426a-4934-a69a-ddf7f2aebea6', 'created_at': datetime.datetime(2026, 7, 21, 0, 0, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 0, 0, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5de785ea-426a-4934-a69a-ddf7f2aebea6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:22:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53556871-51cc-4bd1-9ff7-df008cf52cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:22:08 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Volume volume-269575c0-a96d-4bdc-a323-83614a144a62 (269575c0-a96d-4bdc-a323-83614a144a62): created successfully Jul 21 02:22:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53556871-51cc-4bd1-9ff7-df008cf52cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:22:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Flow 'volume_create_manager' (44d635c9-a5ee-4750-bc60-c632fe74123e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:22:08 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-0e40d2f4-e61a-4704-a541-dffbfbcad9c7 tempest-TestShelveInstance-766707544 None] Created volume successfully. Jul 21 02:22:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-7b002ebb-a013-4e77-89b2-988625bdd950 req-d489881d-34db-4883-ab53-b7518ce1620e tempest-TestShelveInstance-766707544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:22:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-7b002ebb-a013-4e77-89b2-988625bdd950 req-d489881d-34db-4883-ab53-b7518ce1620e tempest-TestShelveInstance-766707544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:22:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-7b002ebb-a013-4e77-89b2-988625bdd950 req-d489881d-34db-4883-ab53-b7518ce1620e tempest-TestShelveInstance-766707544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:22:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-7b002ebb-a013-4e77-89b2-988625bdd950 req-d489881d-34db-4883-ab53-b7518ce1620e tempest-TestShelveInstance-766707544 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea', 'name': 'volume-269575c0-a96d-4bdc-a323-83614a144a62', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5fb571cb-c58c-451f-9810-8ad2dcb70d38', 'enforce_multipath': True} {{(pid=87566) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 02:22:11 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-7b002ebb-a013-4e77-89b2-988625bdd950 req-d489881d-34db-4883-ab53-b7518ce1620e tempest-TestShelveInstance-766707544 None] attachment_update completed successfully. Jul 21 02:22:21 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=16,cinder:UPDATE=6,cinder:INSERT=6 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:22:21 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:UPDATE=6,cinder:SELECT=16,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:22:43 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-6e85eee9-393b-4b11-b2a6-07d860e5bd3e req-7d96e1bb-0a94-4007-9091-aa61863b0e3c tempest-TestShelveInstance-766707544 None] Terminate volume connection completed successfully. Jul 21 02:22:43 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-6e85eee9-393b-4b11-b2a6-07d860e5bd3e req-7d96e1bb-0a94-4007-9091-aa61863b0e3c tempest-TestShelveInstance-766707544 None] Deleting attachment 5fb571cb-c58c-451f-9810-8ad2dcb70d38. {{(pid=87566) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 02:22:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-201a5bb5-a6cf-419c-91cd-1d77cecf2972 req-5b0320da-6027-482f-b2c6-38b4395bad68 tempest-TestShelveInstance-766707544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:22:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-201a5bb5-a6cf-419c-91cd-1d77cecf2972 req-5b0320da-6027-482f-b2c6-38b4395bad68 tempest-TestShelveInstance-766707544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:22:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-201a5bb5-a6cf-419c-91cd-1d77cecf2972 req-5b0320da-6027-482f-b2c6-38b4395bad68 tempest-TestShelveInstance-766707544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:22:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-201a5bb5-a6cf-419c-91cd-1d77cecf2972 req-5b0320da-6027-482f-b2c6-38b4395bad68 tempest-TestShelveInstance-766707544 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea', 'name': 'volume-269575c0-a96d-4bdc-a323-83614a144a62', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e470f9e-ab55-4d3a-a1c4-b4add351ad76', 'enforce_multipath': True} {{(pid=87566) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 02:22:45 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-201a5bb5-a6cf-419c-91cd-1d77cecf2972 req-5b0320da-6027-482f-b2c6-38b4395bad68 tempest-TestShelveInstance-766707544 None] attachment_update completed successfully. Jul 21 02:22:48 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:22:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:22:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:22:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:22:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:22:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:22:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:22:48 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:22:48 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:22:49 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Jul 21 02:22:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.269s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:22:49 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:22:49 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager._thread_info {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:22:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread count: 28 {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 02:22:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread info: [<_MainThread(MainThread, started 135786703114368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 02:22:55 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:22:55 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=11,cinder:UPDATE=1 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:23:11 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-a5896f46-63f5-4c3a-9bfd-67febe529ddf req-7eb2c408-52a6-4866-b208-0fdb53e9fd44 tempest-TestShelveInstance-766707544 None] Terminate volume connection completed successfully. Jul 21 02:23:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [req-a5896f46-63f5-4c3a-9bfd-67febe529ddf req-7eb2c408-52a6-4866-b208-0fdb53e9fd44 tempest-TestShelveInstance-766707544 None] Deleting attachment 0e470f9e-ab55-4d3a-a1c4-b4add351ad76. {{(pid=87566) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 02:23:11 devstack cinder-volume[87566]: DEBUG cinder.coordination [req-a5896f46-63f5-4c3a-9bfd-67febe529ddf req-dc5c78cf-6e49-4e66-a76b-39e993fe7eb4 tempest-TestShelveInstance-766707544 None] Acquiring lock "cinder-269575c0-a96d-4bdc-a323-83614a144a62-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:23:11 devstack cinder-volume[87566]: DEBUG cinder.coordination [req-a5896f46-63f5-4c3a-9bfd-67febe529ddf req-dc5c78cf-6e49-4e66-a76b-39e993fe7eb4 tempest-TestShelveInstance-766707544 None] Lock "cinder-269575c0-a96d-4bdc-a323-83614a144a62-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:23:11 devstack cinder-volume[87566]: DEBUG cinder.coordination [req-a5896f46-63f5-4c3a-9bfd-67febe529ddf req-dc5c78cf-6e49-4e66-a76b-39e993fe7eb4 tempest-TestShelveInstance-766707544 None] Acquiring lock "cinder-quobyte-269575c0-a96d-4bdc-a323-83614a144a62" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:23:11 devstack cinder-volume[87566]: DEBUG cinder.coordination [req-a5896f46-63f5-4c3a-9bfd-67febe529ddf req-dc5c78cf-6e49-4e66-a76b-39e993fe7eb4 tempest-TestShelveInstance-766707544 None] Lock "cinder-quobyte-269575c0-a96d-4bdc-a323-83614a144a62" acquired by "delete_volume" :: waited 0.016s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:23:11 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a47dd3f-4c23-4fbf-afe4-616da3324980]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:23:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-a5896f46-63f5-4c3a-9bfd-67febe529ddf req-dc5c78cf-6e49-4e66-a76b-39e993fe7eb4 tempest-TestShelveInstance-766707544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-269575c0-a96d-4bdc-a323-83614a144a62 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:11 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-269575c0-a96d-4bdc-a323-83614a144a62 Jul 21 02:23:11 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:12 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-a5896f46-63f5-4c3a-9bfd-67febe529ddf req-dc5c78cf-6e49-4e66-a76b-39e993fe7eb4 tempest-TestShelveInstance-766707544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-269575c0-a96d-4bdc-a323-83614a144a62" returned: 0 in 0.360s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-a5896f46-63f5-4c3a-9bfd-67febe529ddf req-dc5c78cf-6e49-4e66-a76b-39e993fe7eb4 tempest-TestShelveInstance-766707544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-269575c0-a96d-4bdc-a323-83614a144a62 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:12 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-269575c0-a96d-4bdc-a323-83614a144a62 Jul 21 02:23:12 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:12 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-a5896f46-63f5-4c3a-9bfd-67febe529ddf req-dc5c78cf-6e49-4e66-a76b-39e993fe7eb4 tempest-TestShelveInstance-766707544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-269575c0-a96d-4bdc-a323-83614a144a62" returned: 0 in 0.242s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:12 devstack cinder-volume[87566]: DEBUG cinder.coordination [req-a5896f46-63f5-4c3a-9bfd-67febe529ddf req-dc5c78cf-6e49-4e66-a76b-39e993fe7eb4 tempest-TestShelveInstance-766707544 None] Lock "cinder-quobyte-269575c0-a96d-4bdc-a323-83614a144a62" released by "delete_volume" :: held 0.656s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:23:12 devstack cinder-volume[87566]: DEBUG cinder.quota [req-a5896f46-63f5-4c3a-9bfd-67febe529ddf req-dc5c78cf-6e49-4e66-a76b-39e993fe7eb4 tempest-TestShelveInstance-766707544 None] Created reservations ['883bf704-139c-4bc0-9f17-bfbaea6eb84e', 'c41d8cce-24b1-4b1b-b30a-0052a453d84c', '4392ce0d-f08f-47cd-85f0-ac471a65f118', '41e781d5-5fd2-4431-8e4f-a0b764b6b0a5'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:23:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-a5896f46-63f5-4c3a-9bfd-67febe529ddf req-dc5c78cf-6e49-4e66-a76b-39e993fe7eb4 tempest-TestShelveInstance-766707544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:23:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-a5896f46-63f5-4c3a-9bfd-67febe529ddf req-dc5c78cf-6e49-4e66-a76b-39e993fe7eb4 tempest-TestShelveInstance-766707544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:23:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [req-a5896f46-63f5-4c3a-9bfd-67febe529ddf req-dc5c78cf-6e49-4e66-a76b-39e993fe7eb4 tempest-TestShelveInstance-766707544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:23:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [req-a5896f46-63f5-4c3a-9bfd-67febe529ddf req-dc5c78cf-6e49-4e66-a76b-39e993fe7eb4 tempest-TestShelveInstance-766707544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:23:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [req-a5896f46-63f5-4c3a-9bfd-67febe529ddf req-dc5c78cf-6e49-4e66-a76b-39e993fe7eb4 tempest-TestShelveInstance-766707544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:23:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-a5896f46-63f5-4c3a-9bfd-67febe529ddf req-dc5c78cf-6e49-4e66-a76b-39e993fe7eb4 tempest-TestShelveInstance-766707544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:12 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:23:12 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:12 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [req-a5896f46-63f5-4c3a-9bfd-67febe529ddf req-dc5c78cf-6e49-4e66-a76b-39e993fe7eb4 tempest-TestShelveInstance-766707544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.245s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:12 devstack cinder-volume[87566]: DEBUG cinder.manager [req-a5896f46-63f5-4c3a-9bfd-67febe529ddf req-dc5c78cf-6e49-4e66-a76b-39e993fe7eb4 tempest-TestShelveInstance-766707544 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:23:12 devstack cinder-volume[87566]: INFO cinder.volume.manager [req-a5896f46-63f5-4c3a-9bfd-67febe529ddf req-dc5c78cf-6e49-4e66-a76b-39e993fe7eb4 tempest-TestShelveInstance-766707544 None] Deleted volume successfully. Jul 21 02:23:12 devstack cinder-volume[87566]: DEBUG cinder.coordination [req-a5896f46-63f5-4c3a-9bfd-67febe529ddf req-dc5c78cf-6e49-4e66-a76b-39e993fe7eb4 tempest-TestShelveInstance-766707544 None] Lock "cinder-269575c0-a96d-4bdc-a323-83614a144a62-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:23:22 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:23:22 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:UPDATE=9,cinder:SELECT=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:23:25 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:23:25 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Flow 'volume_create_manager' (28550c07-86be-4165-82e7-6af7d39ce620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:23:25 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d70a0ed2-c3d2-4383-a658-0e133911587a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:23:25 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d70a0ed2-c3d2-4383-a658-0e133911587a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebc40aae-d046-4a5e-9405-ef26936799c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e841d033ef43ddb1ace072119dd44c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:23:26Z,use_quota=True,user_id='00776152eb794485af5a58589d03ac88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25de7b33-957a-4a1e-8878-e084da8cdfc3),volume_type_id=25de7b33-957a-4a1e-8878-e084da8cdfc3)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:23:25 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e04558-a6fe-4fed-93d7-591c8124250e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:23:25 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e04558-a6fe-4fed-93d7-591c8124250e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:23:25 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19efd40b-cc05-434e-b563-47b52406e72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:23:25 devstack cinder-volume[87566]: DEBUG cinder.image.glance [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Creating Keystone auth plugin from conf {{(pid=87566) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 02:23:25 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19efd40b-cc05-434e-b563-47b52406e72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ebc40aae-d046-4a5e-9405-ef26936799c8', 'volume_name': 'volume-ebc40aae-d046-4a5e-9405-ef26936799c8', 'volume_size': 1, 'image_id': '39bdb998-2f2c-478f-93e8-976c73892d15', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/39bdb998-2f2c-478f-93e8-976c73892d15', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ab6903aaee581e1eacca967499a5b3c5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '12e841d033ef43ddb1ace072119dd44c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4335f977c17fc05cceb897e1a8a060d7dfe778bb58770f42794fc20177f4da1a7ff12608761f801297084835ae1b7b319c860fb3266bd2e55c1f86dedd14cc06', 'id': '39bdb998-2f2c-478f-93e8-976c73892d15', 'created_at': datetime.datetime(2026, 7, 21, 0, 23, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 0, 23, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/39bdb998-2f2c-478f-93e8-976c73892d15/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:23:25 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e8c6398-9326-48cd-b10d-3736e8e21566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:23:25 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e8c6398-9326-48cd-b10d-3736e8e21566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:23:25 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dac858c-8889-403b-abbf-73852cc65af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:23:25 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Volume ebc40aae-d046-4a5e-9405-ef26936799c8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ebc40aae-d046-4a5e-9405-ef26936799c8', 'volume_size': 1, 'image_id': '39bdb998-2f2c-478f-93e8-976c73892d15', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/39bdb998-2f2c-478f-93e8-976c73892d15', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ab6903aaee581e1eacca967499a5b3c5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '12e841d033ef43ddb1ace072119dd44c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4335f977c17fc05cceb897e1a8a060d7dfe778bb58770f42794fc20177f4da1a7ff12608761f801297084835ae1b7b319c860fb3266bd2e55c1f86dedd14cc06', 'id': '39bdb998-2f2c-478f-93e8-976c73892d15', 'created_at': datetime.datetime(2026, 7, 21, 0, 23, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 0, 23, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/39bdb998-2f2c-478f-93e8-976c73892d15/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 21 02:23:25 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Trying to clone ebc40aae-d046-4a5e-9405-ef26936799c8 from image 39bdb998-2f2c-478f-93e8-976c73892d15 at location (None, [{'url': 'file:///opt/stack/data/glance/images/39bdb998-2f2c-478f-93e8-976c73892d15', 'metadata': {}}]). {{(pid=87566) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 02:23:25 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_39bdb998-2f2c-478f-93e8-976c73892d15_v5v6mq6mdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87566) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 02:23:25 devstack cinder-volume[87566]: INFO cinder.image.image_utils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Image download 0.00 MB at 0.00 MB/s Jul 21 02:23:25 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77c7e81-4b7b-4b09-a9e4-fdee30a64553]: (4, 'raw') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:23:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39bdb998-2f2c-478f-93e8-976c73892d15_v5v6mq6mdevstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:26 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39bdb998-2f2c-478f-93e8-976c73892d15_v5v6mq6mdevstack@QuobyteHD Jul 21 02:23:26 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:26 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39bdb998-2f2c-478f-93e8-976c73892d15_v5v6mq6mdevstack@QuobyteHD" returned: 0 in 0.317s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39bdb998-2f2c-478f-93e8-976c73892d15_v5v6mq6mdevstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:26 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39bdb998-2f2c-478f-93e8-976c73892d15_v5v6mq6mdevstack@QuobyteHD Jul 21 02:23:26 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:26 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39bdb998-2f2c-478f-93e8-976c73892d15_v5v6mq6mdevstack@QuobyteHD" returned: 1 in 0.317s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39bdb998-2f2c-478f-93e8-976c73892d15_v5v6mq6mdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 02:23:26 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Temporary image 39bdb998-2f2c-478f-93e8-976c73892d15 is fetched for user 00776152eb794485af5a58589d03ac88. {{(pid=87566) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 02:23:26 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[632f422d-0f47-4d0c-aa84-bfca7e3b2728]: (4, 'raw') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:23:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39bdb998-2f2c-478f-93e8-976c73892d15_v5v6mq6mdevstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:26 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39bdb998-2f2c-478f-93e8-976c73892d15_v5v6mq6mdevstack@QuobyteHD Jul 21 02:23:26 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:26 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39bdb998-2f2c-478f-93e8-976c73892d15_v5v6mq6mdevstack@QuobyteHD" returned: 0 in 0.318s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39bdb998-2f2c-478f-93e8-976c73892d15_v5v6mq6mdevstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:27 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39bdb998-2f2c-478f-93e8-976c73892d15_v5v6mq6mdevstack@QuobyteHD Jul 21 02:23:27 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:27 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39bdb998-2f2c-478f-93e8-976c73892d15_v5v6mq6mdevstack@QuobyteHD" returned: 1 in 0.316s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39bdb998-2f2c-478f-93e8-976c73892d15_v5v6mq6mdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 02:23:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:23:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:23:27 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebc40aae-d046-4a5e-9405-ef26936799c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e841d033ef43ddb1ace072119dd44c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:23:26Z,use_quota=True,user_id='00776152eb794485af5a58589d03ac88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25de7b33-957a-4a1e-8878-e084da8cdfc3),volume_type_id=25de7b33-957a-4a1e-8878-e084da8cdfc3)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:23:27 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Creating volume ebc40aae-d046-4a5e-9405-ef26936799c8 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:23:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:23:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:23:27 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:23:27 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:23:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:23:27 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:23:27 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:23:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ebc40aae-d046-4a5e-9405-ef26936799c8 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:27 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ebc40aae-d046-4a5e-9405-ef26936799c8 1073741824 Jul 21 02:23:27 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:27 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ebc40aae-d046-4a5e-9405-ef26936799c8 1073741824" returned: 0 in 0.421s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ebc40aae-d046-4a5e-9405-ef26936799c8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:27 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ebc40aae-d046-4a5e-9405-ef26936799c8 Jul 21 02:23:27 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:28 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ebc40aae-d046-4a5e-9405-ef26936799c8" returned: 0 in 0.235s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:28 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:23:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:23:28 devstack cinder-volume[87566]: DEBUG cinder.volume.volume_utils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Attempting download of 39bdb998-2f2c-478f-93e8-976c73892d15 ((None, [{'url': 'file:///opt/stack/data/glance/images/39bdb998-2f2c-478f-93e8-976c73892d15', 'metadata': {}}])) to volume ebc40aae-d046-4a5e-9405-ef26936799c8. {{(pid=87566) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 02:23:28 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dba261c-0ed5-41ac-85aa-4bb8a3b2071c]: (4, 'raw') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:23:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_39bdb998-2f2c-478f-93e8-976c73892d15_y8tluh1s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:28 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_39bdb998-2f2c-478f-93e8-976c73892d15_y8tluh1s Jul 21 02:23:28 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:28 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_39bdb998-2f2c-478f-93e8-976c73892d15_y8tluh1s" returned: 0 in 0.311s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_39bdb998-2f2c-478f-93e8-976c73892d15_y8tluh1s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:28 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_39bdb998-2f2c-478f-93e8-976c73892d15_y8tluh1s Jul 21 02:23:28 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:28 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_39bdb998-2f2c-478f-93e8-976c73892d15_y8tluh1s" returned: 1 in 0.312s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_39bdb998-2f2c-478f-93e8-976c73892d15_y8tluh1s' failed. Not Retrying. {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 02:23:28 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48e16f0-5f26-4ebc-8e26-8a794ff89412]: (4, 'raw') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:23:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39bdb998-2f2c-478f-93e8-976c73892d15_v5v6mq6mdevstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:28 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39bdb998-2f2c-478f-93e8-976c73892d15_v5v6mq6mdevstack@QuobyteHD Jul 21 02:23:28 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:29 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39bdb998-2f2c-478f-93e8-976c73892d15_v5v6mq6mdevstack@QuobyteHD" returned: 0 in 0.307s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39bdb998-2f2c-478f-93e8-976c73892d15_v5v6mq6mdevstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:29 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39bdb998-2f2c-478f-93e8-976c73892d15_v5v6mq6mdevstack@QuobyteHD Jul 21 02:23:29 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:29 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39bdb998-2f2c-478f-93e8-976c73892d15_v5v6mq6mdevstack@QuobyteHD" returned: 1 in 0.312s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39bdb998-2f2c-478f-93e8-976c73892d15_v5v6mq6mdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 02:23:29 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] 39bdb998-2f2c-478f-93e8-976c73892d15 was raw, converting to qcow2 {{(pid=87566) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 02:23:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_39bdb998-2f2c-478f-93e8-976c73892d15_v5v6mq6mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ebc40aae-d046-4a5e-9405-ef26936799c8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:29 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_39bdb998-2f2c-478f-93e8-976c73892d15_v5v6mq6mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ebc40aae-d046-4a5e-9405-ef26936799c8 Jul 21 02:23:29 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:29 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_39bdb998-2f2c-478f-93e8-976c73892d15_v5v6mq6mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ebc40aae-d046-4a5e-9405-ef26936799c8" returned: 0 in 0.427s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:29 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_39bdb998-2f2c-478f-93e8-976c73892d15_v5v6mq6mdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ebc40aae-d046-4a5e-9405-ef26936799c8 {{(pid=87566) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 02:23:29 devstack cinder-volume[87566]: INFO cinder.image.image_utils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Converted 0.00 MB image at 0.00 MB/s Jul 21 02:23:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ebc40aae-d046-4a5e-9405-ef26936799c8 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:29 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ebc40aae-d046-4a5e-9405-ef26936799c8 1G Jul 21 02:23:29 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:30 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ebc40aae-d046-4a5e-9405-ef26936799c8 1G" returned: 0 in 0.290s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:30 devstack cinder-volume[87566]: DEBUG cinder.volume.volume_utils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Downloaded image 39bdb998-2f2c-478f-93e8-976c73892d15 ((None, [{'url': 'file:///opt/stack/data/glance/images/39bdb998-2f2c-478f-93e8-976c73892d15', 'metadata': {}}])) to volume ebc40aae-d046-4a5e-9405-ef26936799c8 successfully. {{(pid=87566) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 02:23:30 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Temporary image 39bdb998-2f2c-478f-93e8-976c73892d15 for user 00776152eb794485af5a58589d03ac88 is deleted. {{(pid=87566) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 02:23:30 devstack cinder-volume[87566]: DEBUG cinder.volume.volume_utils [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Marking volume ebc40aae-d046-4a5e-9405-ef26936799c8 as bootable. {{(pid=87566) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 02:23:30 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Copying metadata from image 39bdb998-2f2c-478f-93e8-976c73892d15 to ebc40aae-d046-4a5e-9405-ef26936799c8. {{(pid=87566) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 02:23:30 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Creating volume glance metadata for volume ebc40aae-d046-4a5e-9405-ef26936799c8 backed by image 39bdb998-2f2c-478f-93e8-976c73892d15 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '39bdb998-2f2c-478f-93e8-976c73892d15', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ab6903aaee581e1eacca967499a5b3c5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87566) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 02:23:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dac858c-8889-403b-abbf-73852cc65af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebc40aae-d046-4a5e-9405-ef26936799c8', 'volume_size': 1, 'image_id': '39bdb998-2f2c-478f-93e8-976c73892d15', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/39bdb998-2f2c-478f-93e8-976c73892d15', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ab6903aaee581e1eacca967499a5b3c5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '12e841d033ef43ddb1ace072119dd44c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4335f977c17fc05cceb897e1a8a060d7dfe778bb58770f42794fc20177f4da1a7ff12608761f801297084835ae1b7b319c860fb3266bd2e55c1f86dedd14cc06', 'id': '39bdb998-2f2c-478f-93e8-976c73892d15', 'created_at': datetime.datetime(2026, 7, 21, 0, 23, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 0, 23, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/39bdb998-2f2c-478f-93e8-976c73892d15/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:23:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70ac49c5-bc37-4b25-b104-3b7a3e2a23fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:23:30 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Volume volume-ebc40aae-d046-4a5e-9405-ef26936799c8 (ebc40aae-d046-4a5e-9405-ef26936799c8): created successfully Jul 21 02:23:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70ac49c5-bc37-4b25-b104-3b7a3e2a23fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:23:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Flow 'volume_create_manager' (28550c07-86be-4165-82e7-6af7d39ce620) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:23:30 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-6901a521-d91e-4197-b9b1-8e3483a18ba0 tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Created volume successfully. Jul 21 02:23:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-0eee5123-8397-437e-852f-cd72a1ddcc8a tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Acquiring lock "cinder-ebc40aae-d046-4a5e-9405-ef26936799c8-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:23:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-0eee5123-8397-437e-852f-cd72a1ddcc8a tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Lock "cinder-ebc40aae-d046-4a5e-9405-ef26936799c8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:23:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-0eee5123-8397-437e-852f-cd72a1ddcc8a tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Acquiring lock "cinder-quobyte-ebc40aae-d046-4a5e-9405-ef26936799c8" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:23:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-0eee5123-8397-437e-852f-cd72a1ddcc8a tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Lock "cinder-quobyte-ebc40aae-d046-4a5e-9405-ef26936799c8" acquired by "delete_volume" :: waited 0.013s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:23:30 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[385a9ca9-73a4-4f67-a17a-978cd4edb40b]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:23:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0eee5123-8397-437e-852f-cd72a1ddcc8a tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ebc40aae-d046-4a5e-9405-ef26936799c8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:31 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ebc40aae-d046-4a5e-9405-ef26936799c8 Jul 21 02:23:31 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:31 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0eee5123-8397-437e-852f-cd72a1ddcc8a tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ebc40aae-d046-4a5e-9405-ef26936799c8" returned: 0 in 0.348s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0eee5123-8397-437e-852f-cd72a1ddcc8a tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ebc40aae-d046-4a5e-9405-ef26936799c8 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:31 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ebc40aae-d046-4a5e-9405-ef26936799c8 Jul 21 02:23:31 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:31 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0eee5123-8397-437e-852f-cd72a1ddcc8a tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ebc40aae-d046-4a5e-9405-ef26936799c8" returned: 0 in 0.237s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:31 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-0eee5123-8397-437e-852f-cd72a1ddcc8a tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Lock "cinder-quobyte-ebc40aae-d046-4a5e-9405-ef26936799c8" released by "delete_volume" :: held 0.622s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:23:31 devstack cinder-volume[87566]: WARNING cinder.quota [None req-0eee5123-8397-437e-852f-cd72a1ddcc8a tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 21 02:23:31 devstack cinder-volume[87566]: WARNING cinder.quota [None req-0eee5123-8397-437e-852f-cd72a1ddcc8a tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 21 02:23:31 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-0eee5123-8397-437e-852f-cd72a1ddcc8a tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Created reservations ['07483e29-1f15-4d2c-b9b7-2cbd0e4d6003', '465f2f65-3297-41a2-80d3-b18f95bc9af9', '8bc3ea0a-4f7b-417e-af0c-8ef609e67fc8', 'f55b5858-c847-4c20-a65d-cf2c43a28cf1'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:23:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0eee5123-8397-437e-852f-cd72a1ddcc8a tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:23:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0eee5123-8397-437e-852f-cd72a1ddcc8a tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:23:31 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0eee5123-8397-437e-852f-cd72a1ddcc8a tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:23:31 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-0eee5123-8397-437e-852f-cd72a1ddcc8a tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:23:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0eee5123-8397-437e-852f-cd72a1ddcc8a tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:23:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0eee5123-8397-437e-852f-cd72a1ddcc8a tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:31 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:23:31 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:31 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0eee5123-8397-437e-852f-cd72a1ddcc8a tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.245s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:31 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-0eee5123-8397-437e-852f-cd72a1ddcc8a tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:23:31 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-0eee5123-8397-437e-852f-cd72a1ddcc8a tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Deleted volume successfully. Jul 21 02:23:31 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-0eee5123-8397-437e-852f-cd72a1ddcc8a tempest-VolumeAndVolumeTypeFromImageTest-756896514 None] Lock "cinder-ebc40aae-d046-4a5e-9405-ef26936799c8-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:23:38 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:23:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Flow 'volume_create_manager' (da889595-ea4f-422c-9aa0-83776296e67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:23:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb7b015-ad24-47c9-bb7e-9c6ff1b6a886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:23:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb7b015-ad24-47c9-bb7e-9c6ff1b6a886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=868e599a-8a6c-4514-b890-300a3f610a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba1bd8a6afd498387eccf558d98f076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:23:38Z,use_quota=True,user_id='84f837835de54a0abd9f1e89cac1a24a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:23:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67939076-a8db-4751-b3f0-8c7d1e641258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:23:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67939076-a8db-4751-b3f0-8c7d1e641258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:23:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f25d305-be53-41c5-a2f6-89e6d22c4418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:23:38 devstack cinder-volume[87566]: DEBUG cinder.image.glance [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Creating Keystone auth plugin from conf {{(pid=87566) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 02:23:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f25d305-be53-41c5-a2f6-89e6d22c4418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '868e599a-8a6c-4514-b890-300a3f610a6b', 'volume_name': 'volume-868e599a-8a6c-4514-b890-300a3f610a6b', 'volume_size': 1, 'image_id': '1f29c015-cd62-4b30-97d1-d63c72e0020b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f29c015-cd62-4b30-97d1-d63c72e0020b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c5b61a9abd3c6474650c0408a6b87d8f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cba1bd8a6afd498387eccf558d98f076', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4132fb37da3e8f7eed58db6d6eae2b1fb76743a460edbb4ebb5a42cbdb3441acfdef3456d53c1a03cff12142ed805551eb14696976bed942a9431d22de1f285b', 'id': '1f29c015-cd62-4b30-97d1-d63c72e0020b', 'created_at': datetime.datetime(2026, 7, 21, 0, 23, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 0, 23, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f29c015-cd62-4b30-97d1-d63c72e0020b/file', 'properties': {}}, 'image_service': }' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:23:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (130c8d6c-0027-4f4f-b52b-bbe02b1136a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:23:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (130c8d6c-0027-4f4f-b52b-bbe02b1136a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:23:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d43640e9-1180-4ae9-a94f-8e1bab854c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:23:38 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Volume 868e599a-8a6c-4514-b890-300a3f610a6b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-868e599a-8a6c-4514-b890-300a3f610a6b', 'volume_size': 1, 'image_id': '1f29c015-cd62-4b30-97d1-d63c72e0020b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f29c015-cd62-4b30-97d1-d63c72e0020b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c5b61a9abd3c6474650c0408a6b87d8f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cba1bd8a6afd498387eccf558d98f076', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4132fb37da3e8f7eed58db6d6eae2b1fb76743a460edbb4ebb5a42cbdb3441acfdef3456d53c1a03cff12142ed805551eb14696976bed942a9431d22de1f285b', 'id': '1f29c015-cd62-4b30-97d1-d63c72e0020b', 'created_at': datetime.datetime(2026, 7, 21, 0, 23, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 0, 23, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f29c015-cd62-4b30-97d1-d63c72e0020b/file', 'properties': {}}, 'image_service': } Jul 21 02:23:38 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Trying to clone 868e599a-8a6c-4514-b890-300a3f610a6b from image 1f29c015-cd62-4b30-97d1-d63c72e0020b at location (None, [{'url': 'file:///opt/stack/data/glance/images/1f29c015-cd62-4b30-97d1-d63c72e0020b', 'metadata': {}}]). {{(pid=87566) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 02:23:38 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1f29c015-cd62-4b30-97d1-d63c72e0020b_ldrb5lttdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87566) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 02:23:38 devstack cinder-volume[87566]: INFO cinder.image.image_utils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Image download 0.00 MB at 0.00 MB/s Jul 21 02:23:38 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80404d2-605f-4260-9284-a85c81b48abf]: (4, 'raw') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:23:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f29c015-cd62-4b30-97d1-d63c72e0020b_ldrb5lttdevstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:38 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f29c015-cd62-4b30-97d1-d63c72e0020b_ldrb5lttdevstack@QuobyteHD Jul 21 02:23:38 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:38 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f29c015-cd62-4b30-97d1-d63c72e0020b_ldrb5lttdevstack@QuobyteHD" returned: 0 in 0.321s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f29c015-cd62-4b30-97d1-d63c72e0020b_ldrb5lttdevstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:38 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f29c015-cd62-4b30-97d1-d63c72e0020b_ldrb5lttdevstack@QuobyteHD Jul 21 02:23:38 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:39 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f29c015-cd62-4b30-97d1-d63c72e0020b_ldrb5lttdevstack@QuobyteHD" returned: 1 in 0.316s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f29c015-cd62-4b30-97d1-d63c72e0020b_ldrb5lttdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 02:23:39 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Temporary image 1f29c015-cd62-4b30-97d1-d63c72e0020b is fetched for user 84f837835de54a0abd9f1e89cac1a24a. {{(pid=87566) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 02:23:39 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[c093092a-9288-4b5d-9074-f1f8ae86ac94]: (4, 'raw') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:23:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f29c015-cd62-4b30-97d1-d63c72e0020b_ldrb5lttdevstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:39 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f29c015-cd62-4b30-97d1-d63c72e0020b_ldrb5lttdevstack@QuobyteHD Jul 21 02:23:39 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:39 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f29c015-cd62-4b30-97d1-d63c72e0020b_ldrb5lttdevstack@QuobyteHD" returned: 0 in 0.321s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f29c015-cd62-4b30-97d1-d63c72e0020b_ldrb5lttdevstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:39 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f29c015-cd62-4b30-97d1-d63c72e0020b_ldrb5lttdevstack@QuobyteHD Jul 21 02:23:39 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:39 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f29c015-cd62-4b30-97d1-d63c72e0020b_ldrb5lttdevstack@QuobyteHD" returned: 1 in 0.317s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f29c015-cd62-4b30-97d1-d63c72e0020b_ldrb5lttdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 02:23:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:23:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:23:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=868e599a-8a6c-4514-b890-300a3f610a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba1bd8a6afd498387eccf558d98f076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:23:38Z,use_quota=True,user_id='84f837835de54a0abd9f1e89cac1a24a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:23:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Creating volume 868e599a-8a6c-4514-b890-300a3f610a6b {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:23:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:23:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:23:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:23:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:23:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:23:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:23:39 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:23:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-868e599a-8a6c-4514-b890-300a3f610a6b 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:39 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-868e599a-8a6c-4514-b890-300a3f610a6b 1073741824 Jul 21 02:23:39 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:40 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-868e599a-8a6c-4514-b890-300a3f610a6b 1073741824" returned: 0 in 0.391s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-868e599a-8a6c-4514-b890-300a3f610a6b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:40 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-868e599a-8a6c-4514-b890-300a3f610a6b Jul 21 02:23:40 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:40 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-868e599a-8a6c-4514-b890-300a3f610a6b" returned: 0 in 0.236s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:40 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:23:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:23:40 devstack cinder-volume[87566]: DEBUG cinder.volume.volume_utils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Attempting download of 1f29c015-cd62-4b30-97d1-d63c72e0020b ((None, [{'url': 'file:///opt/stack/data/glance/images/1f29c015-cd62-4b30-97d1-d63c72e0020b', 'metadata': {}}])) to volume 868e599a-8a6c-4514-b890-300a3f610a6b. {{(pid=87566) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 02:23:40 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[156b5a79-3113-496f-9f1d-071df1001024]: (4, 'raw') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:23:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f29c015-cd62-4b30-97d1-d63c72e0020b__f4n1tx4 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:40 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f29c015-cd62-4b30-97d1-d63c72e0020b__f4n1tx4 Jul 21 02:23:40 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:40 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f29c015-cd62-4b30-97d1-d63c72e0020b__f4n1tx4" returned: 0 in 0.312s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f29c015-cd62-4b30-97d1-d63c72e0020b__f4n1tx4 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:40 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f29c015-cd62-4b30-97d1-d63c72e0020b__f4n1tx4 Jul 21 02:23:40 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:41 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f29c015-cd62-4b30-97d1-d63c72e0020b__f4n1tx4" returned: 1 in 0.312s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f29c015-cd62-4b30-97d1-d63c72e0020b__f4n1tx4' failed. Not Retrying. {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 02:23:41 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bfb126-92e3-4f12-a1d2-be9a914e7445]: (4, 'raw') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:23:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f29c015-cd62-4b30-97d1-d63c72e0020b_ldrb5lttdevstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:41 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f29c015-cd62-4b30-97d1-d63c72e0020b_ldrb5lttdevstack@QuobyteHD Jul 21 02:23:41 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:41 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f29c015-cd62-4b30-97d1-d63c72e0020b_ldrb5lttdevstack@QuobyteHD" returned: 0 in 0.311s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f29c015-cd62-4b30-97d1-d63c72e0020b_ldrb5lttdevstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:41 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f29c015-cd62-4b30-97d1-d63c72e0020b_ldrb5lttdevstack@QuobyteHD Jul 21 02:23:41 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:41 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f29c015-cd62-4b30-97d1-d63c72e0020b_ldrb5lttdevstack@QuobyteHD" returned: 1 in 0.316s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f29c015-cd62-4b30-97d1-d63c72e0020b_ldrb5lttdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 02:23:41 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] 1f29c015-cd62-4b30-97d1-d63c72e0020b was raw, converting to qcow2 {{(pid=87566) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 02:23:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1f29c015-cd62-4b30-97d1-d63c72e0020b_ldrb5lttdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-868e599a-8a6c-4514-b890-300a3f610a6b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:41 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1f29c015-cd62-4b30-97d1-d63c72e0020b_ldrb5lttdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-868e599a-8a6c-4514-b890-300a3f610a6b Jul 21 02:23:41 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:42 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1f29c015-cd62-4b30-97d1-d63c72e0020b_ldrb5lttdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-868e599a-8a6c-4514-b890-300a3f610a6b" returned: 0 in 0.416s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:42 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1f29c015-cd62-4b30-97d1-d63c72e0020b_ldrb5lttdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-868e599a-8a6c-4514-b890-300a3f610a6b {{(pid=87566) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 02:23:42 devstack cinder-volume[87566]: INFO cinder.image.image_utils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Converted 0.00 MB image at 0.00 MB/s Jul 21 02:23:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-868e599a-8a6c-4514-b890-300a3f610a6b 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:42 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-868e599a-8a6c-4514-b890-300a3f610a6b 1G Jul 21 02:23:42 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:42 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-868e599a-8a6c-4514-b890-300a3f610a6b 1G" returned: 0 in 0.297s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:42 devstack cinder-volume[87566]: DEBUG cinder.volume.volume_utils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Downloaded image 1f29c015-cd62-4b30-97d1-d63c72e0020b ((None, [{'url': 'file:///opt/stack/data/glance/images/1f29c015-cd62-4b30-97d1-d63c72e0020b', 'metadata': {}}])) to volume 868e599a-8a6c-4514-b890-300a3f610a6b successfully. {{(pid=87566) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 02:23:42 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Temporary image 1f29c015-cd62-4b30-97d1-d63c72e0020b for user 84f837835de54a0abd9f1e89cac1a24a is deleted. {{(pid=87566) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 02:23:42 devstack cinder-volume[87566]: DEBUG cinder.volume.volume_utils [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Marking volume 868e599a-8a6c-4514-b890-300a3f610a6b as bootable. {{(pid=87566) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 02:23:42 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Copying metadata from image 1f29c015-cd62-4b30-97d1-d63c72e0020b to 868e599a-8a6c-4514-b890-300a3f610a6b. {{(pid=87566) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 02:23:42 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Creating volume glance metadata for volume 868e599a-8a6c-4514-b890-300a3f610a6b backed by image 1f29c015-cd62-4b30-97d1-d63c72e0020b with: {'image_id': '1f29c015-cd62-4b30-97d1-d63c72e0020b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c5b61a9abd3c6474650c0408a6b87d8f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87566) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 02:23:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d43640e9-1180-4ae9-a94f-8e1bab854c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-868e599a-8a6c-4514-b890-300a3f610a6b', 'volume_size': 1, 'image_id': '1f29c015-cd62-4b30-97d1-d63c72e0020b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f29c015-cd62-4b30-97d1-d63c72e0020b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c5b61a9abd3c6474650c0408a6b87d8f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cba1bd8a6afd498387eccf558d98f076', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4132fb37da3e8f7eed58db6d6eae2b1fb76743a460edbb4ebb5a42cbdb3441acfdef3456d53c1a03cff12142ed805551eb14696976bed942a9431d22de1f285b', 'id': '1f29c015-cd62-4b30-97d1-d63c72e0020b', 'created_at': datetime.datetime(2026, 7, 21, 0, 23, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 0, 23, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f29c015-cd62-4b30-97d1-d63c72e0020b/file', 'properties': {}}, 'image_service': }' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:23:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce2c9bdd-7aa9-42aa-ad4a-457f6d4dcb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:23:42 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Volume volume-868e599a-8a6c-4514-b890-300a3f610a6b (868e599a-8a6c-4514-b890-300a3f610a6b): created successfully Jul 21 02:23:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce2c9bdd-7aa9-42aa-ad4a-457f6d4dcb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:23:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Flow 'volume_create_manager' (da889595-ea4f-422c-9aa0-83776296e67b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:23:42 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-91c0936b-1be6-4cb2-8571-455be2fade46 tempest-VolumeImageDependencyTests-2062184934 None] Created volume successfully. Jul 21 02:23:43 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-013f934f-fe0f-42d5-8d5a-a75749e31f38 tempest-VolumeImageDependencyTests-2062184934 None] Acquiring lock "cinder-868e599a-8a6c-4514-b890-300a3f610a6b-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:23:43 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-013f934f-fe0f-42d5-8d5a-a75749e31f38 tempest-VolumeImageDependencyTests-2062184934 None] Lock "cinder-868e599a-8a6c-4514-b890-300a3f610a6b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:23:43 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-013f934f-fe0f-42d5-8d5a-a75749e31f38 tempest-VolumeImageDependencyTests-2062184934 None] Acquiring lock "cinder-quobyte-868e599a-8a6c-4514-b890-300a3f610a6b" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:23:43 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-013f934f-fe0f-42d5-8d5a-a75749e31f38 tempest-VolumeImageDependencyTests-2062184934 None] Lock "cinder-quobyte-868e599a-8a6c-4514-b890-300a3f610a6b" acquired by "delete_volume" :: waited 0.013s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:23:43 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcdadf7-865f-4587-a1e5-176176871e7f]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:23:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-013f934f-fe0f-42d5-8d5a-a75749e31f38 tempest-VolumeImageDependencyTests-2062184934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-868e599a-8a6c-4514-b890-300a3f610a6b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:43 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-868e599a-8a6c-4514-b890-300a3f610a6b Jul 21 02:23:43 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:43 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-013f934f-fe0f-42d5-8d5a-a75749e31f38 tempest-VolumeImageDependencyTests-2062184934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-868e599a-8a6c-4514-b890-300a3f610a6b" returned: 0 in 0.342s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-013f934f-fe0f-42d5-8d5a-a75749e31f38 tempest-VolumeImageDependencyTests-2062184934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-868e599a-8a6c-4514-b890-300a3f610a6b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:43 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-868e599a-8a6c-4514-b890-300a3f610a6b Jul 21 02:23:43 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:44 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-013f934f-fe0f-42d5-8d5a-a75749e31f38 tempest-VolumeImageDependencyTests-2062184934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-868e599a-8a6c-4514-b890-300a3f610a6b" returned: 0 in 0.235s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:44 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-013f934f-fe0f-42d5-8d5a-a75749e31f38 tempest-VolumeImageDependencyTests-2062184934 None] Lock "cinder-quobyte-868e599a-8a6c-4514-b890-300a3f610a6b" released by "delete_volume" :: held 0.613s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:23:44 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-013f934f-fe0f-42d5-8d5a-a75749e31f38 tempest-VolumeImageDependencyTests-2062184934 None] Created reservations ['9605198d-0c12-4ec7-8a35-52e78d7fd99f', '992f8340-90c8-4ed5-b9d5-85333fb3b014', '90ca2d01-70b6-47d5-be2d-b3f664e9ae2b', '64f48997-2b2c-460b-910b-91a42f5eb6e5'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:23:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-013f934f-fe0f-42d5-8d5a-a75749e31f38 tempest-VolumeImageDependencyTests-2062184934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:23:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-013f934f-fe0f-42d5-8d5a-a75749e31f38 tempest-VolumeImageDependencyTests-2062184934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:23:44 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-013f934f-fe0f-42d5-8d5a-a75749e31f38 tempest-VolumeImageDependencyTests-2062184934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:23:44 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-013f934f-fe0f-42d5-8d5a-a75749e31f38 tempest-VolumeImageDependencyTests-2062184934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:23:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-013f934f-fe0f-42d5-8d5a-a75749e31f38 tempest-VolumeImageDependencyTests-2062184934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:23:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-013f934f-fe0f-42d5-8d5a-a75749e31f38 tempest-VolumeImageDependencyTests-2062184934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:44 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:23:44 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:44 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-013f934f-fe0f-42d5-8d5a-a75749e31f38 tempest-VolumeImageDependencyTests-2062184934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.241s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:44 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-013f934f-fe0f-42d5-8d5a-a75749e31f38 tempest-VolumeImageDependencyTests-2062184934 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:23:44 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-013f934f-fe0f-42d5-8d5a-a75749e31f38 tempest-VolumeImageDependencyTests-2062184934 None] Deleted volume successfully. Jul 21 02:23:44 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-013f934f-fe0f-42d5-8d5a-a75749e31f38 tempest-VolumeImageDependencyTests-2062184934 None] Lock "cinder-868e599a-8a6c-4514-b890-300a3f610a6b-delete_volume" released by "delete_volume" :: held 1.029s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:23:48 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:23:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:23:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:23:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:23:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:23:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:23:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:23:48 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:23:48 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:23:49 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Jul 21 02:23:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.255s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:23:49 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:23:49 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager._thread_info {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:23:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread count: 28 {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 02:23:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread info: [<_MainThread(MainThread, started 135786703114368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 02:23:54 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=27,cinder:INSERT=13,cinder:UPDATE=26,cinder:DELETE=2 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:23:54 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:UPDATE=24,cinder:SELECT=24,cinder:INSERT=16,cinder:DELETE=2 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:24:04 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:24:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] Flow 'volume_create_manager' (520d2a54-e298-485b-be22-0e3426997990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fbb392c-a13c-454e-abe9-612269d28530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fbb392c-a13c-454e-abe9-612269d28530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-922611884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7894a9a-e7c1-45e1-b24d-9b3c2caf5001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2b89425c73e44059edd6523b6d2c4bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:24:04Z,use_quota=True,user_id='9cfd8bfd5b474304a91787658ed12e09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ffee3e-d373-4bb3-8252-97e89e436626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ffee3e-d373-4bb3-8252-97e89e436626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28571c6e-5c88-493c-b9b0-32a53aeb1510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28571c6e-5c88-493c-b9b0-32a53aeb1510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7894a9a-e7c1-45e1-b24d-9b3c2caf5001', 'volume_name': 'volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c285de8a-5c49-4482-ba94-36fade6f0aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c285de8a-5c49-4482-ba94-36fade6f0aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c50e59-7339-4826-b286-93b1985540f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:04 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] Volume a7894a9a-e7c1-45e1-b24d-9b3c2caf5001: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001', 'volume_size': 1} Jul 21 02:24:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:04 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-922611884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7894a9a-e7c1-45e1-b24d-9b3c2caf5001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2b89425c73e44059edd6523b6d2c4bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:24:04Z,use_quota=True,user_id='9cfd8bfd5b474304a91787658ed12e09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:24:04 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] Creating volume a7894a9a-e7c1-45e1-b24d-9b3c2caf5001 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:24:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:04 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:24:04 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:24:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:04 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:24:04 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:24:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:04 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001 1073741824 Jul 21 02:24:04 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:04 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001 1073741824" returned: 0 in 0.397s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:04 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001 Jul 21 02:24:04 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:05 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001" returned: 0 in 0.230s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:24:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c50e59-7339-4826-b286-93b1985540f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1f7d074-b83a-436e-b643-f6cf2ac1cf4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:05 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] Volume volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001 (a7894a9a-e7c1-45e1-b24d-9b3c2caf5001): created successfully Jul 21 02:24:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1f7d074-b83a-436e-b643-f6cf2ac1cf4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] Flow 'volume_create_manager' (520d2a54-e298-485b-be22-0e3426997990) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:05 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-e9cf4916-354a-4162-8232-a47399a92da1 tempest-SnapshotDependencyTests-1991410633 None] Created volume successfully. Jul 21 02:24:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-992189e3-fa6f-42be-9c62-0170134e6886 tempest-SnapshotDependencyTests-1991410633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-992189e3-fa6f-42be-9c62-0170134e6886 tempest-SnapshotDependencyTests-1991410633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-992189e3-fa6f-42be-9c62-0170134e6886 tempest-SnapshotDependencyTests-1991410633 None] Creating offline snapshot 96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2 of volume a7894a9a-e7c1-45e1-b24d-9b3c2caf5001 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:24:05 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[9878522e-8d8f-446f-b0cc-50ce0aee2a81]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:24:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-992189e3-fa6f-42be-9c62-0170134e6886 tempest-SnapshotDependencyTests-1991410633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:05 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001 Jul 21 02:24:05 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:05 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-992189e3-fa6f-42be-9c62-0170134e6886 tempest-SnapshotDependencyTests-1991410633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001" returned: 0 in 0.362s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-992189e3-fa6f-42be-9c62-0170134e6886 tempest-SnapshotDependencyTests-1991410633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001.96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:05 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001.96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2 1G Jul 21 02:24:05 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:06 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-992189e3-fa6f-42be-9c62-0170134e6886 tempest-SnapshotDependencyTests-1991410633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001.96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2 1G" returned: 0 in 0.378s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-992189e3-fa6f-42be-9c62-0170134e6886 tempest-SnapshotDependencyTests-1991410633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001.96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:06 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001.96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2 Jul 21 02:24:06 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:06 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-992189e3-fa6f-42be-9c62-0170134e6886 tempest-SnapshotDependencyTests-1991410633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001.96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2" returned: 0 in 0.287s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:06 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-992189e3-fa6f-42be-9c62-0170134e6886 tempest-SnapshotDependencyTests-1991410633 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001.96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2 is being set with open permissions: ugo+rw Jul 21 02:24:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-992189e3-fa6f-42be-9c62-0170134e6886 tempest-SnapshotDependencyTests-1991410633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001.96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:06 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001.96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2 Jul 21 02:24:06 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:06 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-992189e3-fa6f-42be-9c62-0170134e6886 tempest-SnapshotDependencyTests-1991410633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001.96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2" returned: 0 in 0.239s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-992189e3-fa6f-42be-9c62-0170134e6886 tempest-SnapshotDependencyTests-1991410633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:06 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001.info Jul 21 02:24:06 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:07 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-992189e3-fa6f-42be-9c62-0170134e6886 tempest-SnapshotDependencyTests-1991410633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001.info" returned: 0 in 0.238s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:07 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-992189e3-fa6f-42be-9c62-0170134e6886 tempest-SnapshotDependencyTests-1991410633 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001.info is being set with open permissions: ugo+rw Jul 21 02:24:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-992189e3-fa6f-42be-9c62-0170134e6886 tempest-SnapshotDependencyTests-1991410633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:07 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001.info Jul 21 02:24:07 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:07 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-992189e3-fa6f-42be-9c62-0170134e6886 tempest-SnapshotDependencyTests-1991410633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001.info" returned: 0 in 0.237s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-992189e3-fa6f-42be-9c62-0170134e6886 tempest-SnapshotDependencyTests-1991410633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.825s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:07 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-992189e3-fa6f-42be-9c62-0170134e6886 tempest-SnapshotDependencyTests-1991410633 None] Create snapshot completed successfully Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Flow 'volume_create_manager' (7a334762-2b4b-4c87-aad1-7f1e2bc4e039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0957816-a862-47fa-994d-077afee74240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0957816-a862-47fa-994d-077afee74240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a8c854b-361d-49e1-9eef-36750b6390c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2b89425c73e44059edd6523b6d2c4bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:24:08Z,use_quota=True,user_id='9cfd8bfd5b474304a91787658ed12e09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d7df67-8dfb-411f-91dd-53453c9b0f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d7df67-8dfb-411f-91dd-53453c9b0f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39dfc96f-de2f-459f-a134-03b7732f2b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39dfc96f-de2f-459f-a134-03b7732f2b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0a8c854b-361d-49e1-9eef-36750b6390c2', 'volume_name': 'volume-0a8c854b-361d-49e1-9eef-36750b6390c2', 'volume_size': 1, 'snapshot_id': '96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2'}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97646c62-b4b4-4fd7-8a0e-869a4a7aef78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97646c62-b4b4-4fd7-8a0e-869a4a7aef78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7ef7d16-dffe-4dff-9095-2dfcb34ae789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:08 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Volume 0a8c854b-361d-49e1-9eef-36750b6390c2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0a8c854b-361d-49e1-9eef-36750b6390c2', 'volume_size': 1, 'snapshot_id': '96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2'} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Acquiring lock "cinder-quobyte-96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2-0a8c854b-361d-49e1-9eef-36750b6390c2" by "_create_volume_from_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Lock "cinder-quobyte-96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2-0a8c854b-361d-49e1-9eef-36750b6390c2" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Creating volume 0a8c854b-361d-49e1-9eef-36750b6390c2 from snapshot 96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2 {{(pid=87566) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Acquiring lock "cinder-quobyte-0a8c854b-361d-49e1-9eef-36750b6390c2" by "_copy_volume_from_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Lock "cinder-quobyte-0a8c854b-361d-49e1-9eef-36750b6390c2" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] snapshot: 96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2, volume: 0a8c854b-361d-49e1-9eef-36750b6390c2, {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40187f1-9be1-41cf-9667-bea99fab46ad]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001.96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:08 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001.96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2 Jul 21 02:24:08 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:08 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001.96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2" returned: 0 in 0.346s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001 {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Creating direct copy from snapshot {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a255a2-20ea-48be-9b09-bd3b26cb87d7]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:24:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:08 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001 Jul 21 02:24:08 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:09 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001" returned: 0 in 0.343s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:09 devstack cinder-volume[87566]: DEBUG cinder.utils [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Path /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a8c854b-361d-49e1-9eef-36750b6390c2 not found in is_blk_device check {{(pid=87566) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 02:24:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a8c854b-361d-49e1-9eef-36750b6390c2 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:09 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a8c854b-361d-49e1-9eef-36750b6390c2 Jul 21 02:24:09 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:12 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a8c854b-361d-49e1-9eef-36750b6390c2" returned: 0 in 3.916s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:12 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[6697ccec-9b8f-4735-b9a3-bcb1b6b51c52]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:24:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:13 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001 Jul 21 02:24:13 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:13 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001" returned: 0 in 0.513s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:13 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Image conversion details: src /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001, size 1024.00 MB, duration 3.92 sec, destination /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a8c854b-361d-49e1-9eef-36750b6390c2 {{(pid=87566) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 02:24:13 devstack cinder-volume[87566]: INFO cinder.image.image_utils [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Converted 1024.00 MB image at 261.40 MB/s Jul 21 02:24:13 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a8c854b-361d-49e1-9eef-36750b6390c2 is being set with open permissions: ugo+rw Jul 21 02:24:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a8c854b-361d-49e1-9eef-36750b6390c2 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:13 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a8c854b-361d-49e1-9eef-36750b6390c2 Jul 21 02:24:13 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:13 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a8c854b-361d-49e1-9eef-36750b6390c2" returned: 0 in 0.232s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:13 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Lock "cinder-quobyte-0a8c854b-361d-49e1-9eef-36750b6390c2" released by "_copy_volume_from_snapshot" :: held 5.433s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:24:13 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Lock "cinder-quobyte-96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2-0a8c854b-361d-49e1-9eef-36750b6390c2" released by "_create_volume_from_snapshot" :: held 5.459s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:24:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.476s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7ef7d16-dffe-4dff-9095-2dfcb34ae789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a8c854b-361d-49e1-9eef-36750b6390c2', 'volume_size': 1, 'snapshot_id': '96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2'}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (299d2827-92eb-4d40-914d-304dacdc1418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:13 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Volume volume-0a8c854b-361d-49e1-9eef-36750b6390c2 (0a8c854b-361d-49e1-9eef-36750b6390c2): created successfully Jul 21 02:24:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (299d2827-92eb-4d40-914d-304dacdc1418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Flow 'volume_create_manager' (7a334762-2b4b-4c87-aad1-7f1e2bc4e039) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:13 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-398610e8-aa5c-4439-95f9-203f67f15f33 tempest-SnapshotDependencyTests-1991410633 None] Created volume successfully. Jul 21 02:24:14 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-22dac505-44a2-4e64-b66c-3c2b861e7ea5 tempest-SnapshotDependencyTests-1991410633 None] Acquiring lock "cinder-96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:14 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-22dac505-44a2-4e64-b66c-3c2b861e7ea5 tempest-SnapshotDependencyTests-1991410633 None] Lock "cinder-96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:14 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-22dac505-44a2-4e64-b66c-3c2b861e7ea5 tempest-SnapshotDependencyTests-1991410633 None] Acquiring lock "cinder-quobyte-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:14 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-22dac505-44a2-4e64-b66c-3c2b861e7ea5 tempest-SnapshotDependencyTests-1991410633 None] Lock "cinder-quobyte-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001" acquired by "delete_snapshot" :: waited 0.012s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:14 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-22dac505-44a2-4e64-b66c-3c2b861e7ea5 tempest-SnapshotDependencyTests-1991410633 None] Acquiring lock "cinder-quobyte-96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:14 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-22dac505-44a2-4e64-b66c-3c2b861e7ea5 tempest-SnapshotDependencyTests-1991410633 None] Lock "cinder-quobyte-96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-22dac505-44a2-4e64-b66c-3c2b861e7ea5 tempest-SnapshotDependencyTests-1991410633 None] Deleting offline snapshot 96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2 of volume a7894a9a-e7c1-45e1-b24d-9b3c2caf5001 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:24:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-22dac505-44a2-4e64-b66c-3c2b861e7ea5 tempest-SnapshotDependencyTests-1991410633 None] snapshot_file for this snap is: volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001.96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:24:14 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[85434ed2-59ff-4e58-83a9-7c4a49161189]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:24:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-22dac505-44a2-4e64-b66c-3c2b861e7ea5 tempest-SnapshotDependencyTests-1991410633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001.96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:14 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001.96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2 Jul 21 02:24:14 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:14 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-22dac505-44a2-4e64-b66c-3c2b861e7ea5 tempest-SnapshotDependencyTests-1991410633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001.96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2" returned: 0 in 0.343s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-22dac505-44a2-4e64-b66c-3c2b861e7ea5 tempest-SnapshotDependencyTests-1991410633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:24:14 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26522cf-3a84-4f83-ae5a-d7e0471d8468]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:24:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-22dac505-44a2-4e64-b66c-3c2b861e7ea5 tempest-SnapshotDependencyTests-1991410633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:14 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001 Jul 21 02:24:14 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:14 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-22dac505-44a2-4e64-b66c-3c2b861e7ea5 tempest-SnapshotDependencyTests-1991410633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001" returned: 0 in 0.343s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-22dac505-44a2-4e64-b66c-3c2b861e7ea5 tempest-SnapshotDependencyTests-1991410633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001.96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:14 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001.96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2 Jul 21 02:24:14 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:15 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-22dac505-44a2-4e64-b66c-3c2b861e7ea5 tempest-SnapshotDependencyTests-1991410633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001.96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2" returned: 0 in 0.317s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-22dac505-44a2-4e64-b66c-3c2b861e7ea5 tempest-SnapshotDependencyTests-1991410633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001.96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:15 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001.96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2 Jul 21 02:24:15 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:15 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-22dac505-44a2-4e64-b66c-3c2b861e7ea5 tempest-SnapshotDependencyTests-1991410633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001.96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2" returned: 0 in 0.238s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:15 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-22dac505-44a2-4e64-b66c-3c2b861e7ea5 tempest-SnapshotDependencyTests-1991410633 None] Lock "cinder-quobyte-96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2" released by "_delete_snapshot" :: held 1.332s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:24:15 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-22dac505-44a2-4e64-b66c-3c2b861e7ea5 tempest-SnapshotDependencyTests-1991410633 None] Lock "cinder-quobyte-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001" released by "delete_snapshot" :: held 1.354s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:24:15 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-22dac505-44a2-4e64-b66c-3c2b861e7ea5 tempest-SnapshotDependencyTests-1991410633 None] Created reservations ['4280f2fc-c814-4c89-88ed-a7208bb31003', '87fcaa99-08a5-44e8-ac48-3e36f81d081f', 'bb72fa40-6f58-49ce-9ecd-bd7bd1d0acaf', '8300159e-9ef4-4a0a-876a-f9a9f4ad280a'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:24:15 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-22dac505-44a2-4e64-b66c-3c2b861e7ea5 tempest-SnapshotDependencyTests-1991410633 None] Delete snapshot completed successfully. Jul 21 02:24:15 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-22dac505-44a2-4e64-b66c-3c2b861e7ea5 tempest-SnapshotDependencyTests-1991410633 None] Lock "cinder-96c7930a-ebc9-4cae-9062-0ddf8a3fb7e2-delete_snapshot" released by "delete_snapshot" :: held 1.474s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:24:16 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1c438b4c-8c3c-485c-b06a-5a7869f02308 tempest-SnapshotDependencyTests-1991410633 None] Acquiring lock "cinder-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:16 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1c438b4c-8c3c-485c-b06a-5a7869f02308 tempest-SnapshotDependencyTests-1991410633 None] Lock "cinder-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:16 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1c438b4c-8c3c-485c-b06a-5a7869f02308 tempest-SnapshotDependencyTests-1991410633 None] Acquiring lock "cinder-quobyte-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:16 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1c438b4c-8c3c-485c-b06a-5a7869f02308 tempest-SnapshotDependencyTests-1991410633 None] Lock "cinder-quobyte-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001" acquired by "delete_volume" :: waited 0.015s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:16 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a9708e-6ce0-473b-8674-9840a2a44ca9]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:24:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1c438b4c-8c3c-485c-b06a-5a7869f02308 tempest-SnapshotDependencyTests-1991410633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:16 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001 Jul 21 02:24:16 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:16 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1c438b4c-8c3c-485c-b06a-5a7869f02308 tempest-SnapshotDependencyTests-1991410633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001" returned: 0 in 0.348s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1c438b4c-8c3c-485c-b06a-5a7869f02308 tempest-SnapshotDependencyTests-1991410633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:16 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001 Jul 21 02:24:16 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:16 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1c438b4c-8c3c-485c-b06a-5a7869f02308 tempest-SnapshotDependencyTests-1991410633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001" returned: 0 in 0.244s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:16 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1c438b4c-8c3c-485c-b06a-5a7869f02308 tempest-SnapshotDependencyTests-1991410633 None] Lock "cinder-quobyte-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001" released by "delete_volume" :: held 0.644s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:24:16 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-1c438b4c-8c3c-485c-b06a-5a7869f02308 tempest-SnapshotDependencyTests-1991410633 None] Created reservations ['f27eeee1-fe22-44a2-8819-84187b5b43f0', 'ced8f457-d76b-444f-a528-8820b5cac049', '15c2ab66-7f26-456c-9b65-82fab82a1d9d', 'd0471c65-d22d-42f2-8d10-4edd8b188d2d'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:24:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-1c438b4c-8c3c-485c-b06a-5a7869f02308 tempest-SnapshotDependencyTests-1991410633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-1c438b4c-8c3c-485c-b06a-5a7869f02308 tempest-SnapshotDependencyTests-1991410633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:16 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-1c438b4c-8c3c-485c-b06a-5a7869f02308 tempest-SnapshotDependencyTests-1991410633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:24:17 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-1c438b4c-8c3c-485c-b06a-5a7869f02308 tempest-SnapshotDependencyTests-1991410633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:24:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-1c438b4c-8c3c-485c-b06a-5a7869f02308 tempest-SnapshotDependencyTests-1991410633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1c438b4c-8c3c-485c-b06a-5a7869f02308 tempest-SnapshotDependencyTests-1991410633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:17 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:24:17 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:17 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-1c438b4c-8c3c-485c-b06a-5a7869f02308 tempest-SnapshotDependencyTests-1991410633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.234s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:17 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-1c438b4c-8c3c-485c-b06a-5a7869f02308 tempest-SnapshotDependencyTests-1991410633 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:24:17 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-1c438b4c-8c3c-485c-b06a-5a7869f02308 tempest-SnapshotDependencyTests-1991410633 None] Deleted volume successfully. Jul 21 02:24:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-1c438b4c-8c3c-485c-b06a-5a7869f02308 tempest-SnapshotDependencyTests-1991410633 None] Lock "cinder-a7894a9a-e7c1-45e1-b24d-9b3c2caf5001-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:24:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-25087d19-7981-4331-ad37-e3d235508c97 tempest-SnapshotDependencyTests-1991410633 None] Acquiring lock "cinder-0a8c854b-361d-49e1-9eef-36750b6390c2-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-25087d19-7981-4331-ad37-e3d235508c97 tempest-SnapshotDependencyTests-1991410633 None] Lock "cinder-0a8c854b-361d-49e1-9eef-36750b6390c2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-25087d19-7981-4331-ad37-e3d235508c97 tempest-SnapshotDependencyTests-1991410633 None] Acquiring lock "cinder-quobyte-0a8c854b-361d-49e1-9eef-36750b6390c2" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-25087d19-7981-4331-ad37-e3d235508c97 tempest-SnapshotDependencyTests-1991410633 None] Lock "cinder-quobyte-0a8c854b-361d-49e1-9eef-36750b6390c2" acquired by "delete_volume" :: waited 0.014s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:17 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91f47dc-6e23-4b6b-aa83-b51cd5b62011]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:24:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-25087d19-7981-4331-ad37-e3d235508c97 tempest-SnapshotDependencyTests-1991410633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a8c854b-361d-49e1-9eef-36750b6390c2 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:17 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a8c854b-361d-49e1-9eef-36750b6390c2 Jul 21 02:24:17 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:17 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-25087d19-7981-4331-ad37-e3d235508c97 tempest-SnapshotDependencyTests-1991410633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a8c854b-361d-49e1-9eef-36750b6390c2" returned: 0 in 0.347s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-25087d19-7981-4331-ad37-e3d235508c97 tempest-SnapshotDependencyTests-1991410633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a8c854b-361d-49e1-9eef-36750b6390c2 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:17 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a8c854b-361d-49e1-9eef-36750b6390c2 Jul 21 02:24:17 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:18 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-25087d19-7981-4331-ad37-e3d235508c97 tempest-SnapshotDependencyTests-1991410633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0a8c854b-361d-49e1-9eef-36750b6390c2" returned: 0 in 0.242s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-25087d19-7981-4331-ad37-e3d235508c97 tempest-SnapshotDependencyTests-1991410633 None] Lock "cinder-quobyte-0a8c854b-361d-49e1-9eef-36750b6390c2" released by "delete_volume" :: held 0.624s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:24:18 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-25087d19-7981-4331-ad37-e3d235508c97 tempest-SnapshotDependencyTests-1991410633 None] Created reservations ['e52201df-5cb0-4c1a-b6f7-fad00bf24432', '3022a749-be39-4d9b-a301-506a71721bd9', '7441b70e-0d42-49d2-b8dd-fd76e8868bcb', 'f18b4dbd-d616-444a-ba68-6afc71b63586'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:24:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-25087d19-7981-4331-ad37-e3d235508c97 tempest-SnapshotDependencyTests-1991410633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-25087d19-7981-4331-ad37-e3d235508c97 tempest-SnapshotDependencyTests-1991410633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-25087d19-7981-4331-ad37-e3d235508c97 tempest-SnapshotDependencyTests-1991410633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:24:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-25087d19-7981-4331-ad37-e3d235508c97 tempest-SnapshotDependencyTests-1991410633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:24:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-25087d19-7981-4331-ad37-e3d235508c97 tempest-SnapshotDependencyTests-1991410633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-25087d19-7981-4331-ad37-e3d235508c97 tempest-SnapshotDependencyTests-1991410633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:18 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:24:18 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:18 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-25087d19-7981-4331-ad37-e3d235508c97 tempest-SnapshotDependencyTests-1991410633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.242s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:18 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-25087d19-7981-4331-ad37-e3d235508c97 tempest-SnapshotDependencyTests-1991410633 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:24:18 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-25087d19-7981-4331-ad37-e3d235508c97 tempest-SnapshotDependencyTests-1991410633 None] Deleted volume successfully. Jul 21 02:24:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-25087d19-7981-4331-ad37-e3d235508c97 tempest-SnapshotDependencyTests-1991410633 None] Lock "cinder-0a8c854b-361d-49e1-9eef-36750b6390c2-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:24:28 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=17,cinder:INSERT=8,cinder:UPDATE=26,cinder:DELETE=2 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:24:28 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=30,cinder:UPDATE=30,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:24:36 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:24:36 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] Flow 'volume_create_manager' (bc6c4e10-6fb9-48e4-8ae3-72f873f377bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:36 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e5d4945-a31f-4932-b798-8a988ddbd62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:36 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e5d4945-a31f-4932-b798-8a988ddbd62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-890334409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=412c9fe6-be9c-49da-8620-08181cb16efb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b95510ba4042559dce28e234f89586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:24:37Z,use_quota=True,user_id='9f959e8a09cb4d3cb414843c26f9ac39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:36 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09976773-8b3b-4693-aabe-d3e96c1480e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:36 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09976773-8b3b-4693-aabe-d3e96c1480e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:36 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (948c0d55-afe9-48d3-b9eb-3e56f09722b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:36 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (948c0d55-afe9-48d3-b9eb-3e56f09722b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '412c9fe6-be9c-49da-8620-08181cb16efb', 'volume_name': 'volume-412c9fe6-be9c-49da-8620-08181cb16efb', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:36 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55d8f709-b853-44ff-89c2-935b476a489b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:36 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55d8f709-b853-44ff-89c2-935b476a489b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:36 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5401c811-96a5-423d-b546-1d715ccd9d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:36 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] Volume 412c9fe6-be9c-49da-8620-08181cb16efb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-412c9fe6-be9c-49da-8620-08181cb16efb', 'volume_size': 1} Jul 21 02:24:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:36 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-890334409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=412c9fe6-be9c-49da-8620-08181cb16efb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b95510ba4042559dce28e234f89586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:24:37Z,use_quota=True,user_id='9f959e8a09cb4d3cb414843c26f9ac39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:24:36 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] Creating volume 412c9fe6-be9c-49da-8620-08181cb16efb {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:24:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:36 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:24:36 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:24:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:36 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:24:36 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:24:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:36 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb 1073741824 Jul 21 02:24:36 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:36 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] Flow 'volume_create_manager' (c3b5e0c8-af08-4f2b-bb77-01ed25a9514f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e23c2b9-703e-4a2a-a174-242c0ded005c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e23c2b9-703e-4a2a-a174-242c0ded005c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1403659752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa28ab87-51dd-439f-8294-94b26cd099c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06457d611bf94a75ad1b883bba7df487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:24:37Z,use_quota=True,user_id='115d7d3efa524a81b5f9bfd8b992d8f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0eb6d78-6607-480e-88a6-c69ee46c2da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0eb6d78-6607-480e-88a6-c69ee46c2da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc9abf2-45bc-4ec3-a1b7-c819db0388a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc9abf2-45bc-4ec3-a1b7-c819db0388a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa28ab87-51dd-439f-8294-94b26cd099c6', 'volume_name': 'volume-aa28ab87-51dd-439f-8294-94b26cd099c6', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51916d2c-ecd7-4194-8517-2216ca98e4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51916d2c-ecd7-4194-8517-2216ca98e4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc749a4-6f8e-47a3-94d4-b0ff99b56d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:37 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] Volume aa28ab87-51dd-439f-8294-94b26cd099c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa28ab87-51dd-439f-8294-94b26cd099c6', 'volume_size': 1} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Flow 'volume_create_manager' (78e260dc-bb12-4de0-9e17-931289cf618a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5549f73c-ed34-4284-bbee-fca832c56346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5549f73c-ed34-4284-bbee-fca832c56346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-213813968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2d7a218-19e6-498b-add4-bc9b1a19dcec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f51ef2d52994a98b517685a68ffab5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:24:37Z,use_quota=True,user_id='44cda6aaa9784b3e97f478fab2914f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cd1e69a-d425-42ba-a5fa-eaf91da58419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cd1e69a-d425-42ba-a5fa-eaf91da58419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (185e70c0-db59-453d-a7d7-f4a3396bb86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (185e70c0-db59-453d-a7d7-f4a3396bb86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2d7a218-19e6-498b-add4-bc9b1a19dcec', 'volume_name': 'volume-f2d7a218-19e6-498b-add4-bc9b1a19dcec', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c85e3b0d-324b-4f5e-8519-103faf565faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:37 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c85e3b0d-324b-4f5e-8519-103faf565faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce12f002-908b-434b-a467-2fc2ea4f3301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:37 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Volume f2d7a218-19e6-498b-add4-bc9b1a19dcec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2d7a218-19e6-498b-add4-bc9b1a19dcec', 'volume_size': 1} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb 1073741824" returned: 0 in 0.697s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] Flow 'volume_create_manager' (807fd3ba-6a4e-4517-90eb-f6b290b1c709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48de79eb-01f8-4f9c-b9ec-878d5d64e1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48de79eb-01f8-4f9c-b9ec-878d5d64e1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1113374368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16f707b0-52c1-4a85-8068-56917486ee76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06457d611bf94a75ad1b883bba7df487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:24:37Z,use_quota=True,user_id='115d7d3efa524a81b5f9bfd8b992d8f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb0a40e-4124-4273-9abd-bc4c666a97ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb0a40e-4124-4273-9abd-bc4c666a97ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d17fba-e90e-45b8-b2be-091644736e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d17fba-e90e-45b8-b2be-091644736e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16f707b0-52c1-4a85-8068-56917486ee76', 'volume_name': 'volume-16f707b0-52c1-4a85-8068-56917486ee76', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bed68b6-5836-4dcc-abaf-a08f8aa98627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bed68b6-5836-4dcc-abaf-a08f8aa98627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61220e5a-d6ac-42ff-9563-db760465e9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:37 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] Volume 16f707b0-52c1-4a85-8068-56917486ee76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16f707b0-52c1-4a85-8068-56917486ee76', 'volume_size': 1} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:37 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb Jul 21 02:24:37 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] Flow 'volume_create_manager' (88bc2c04-75c9-40b1-aab8-72dbceb8e2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96a1816-f80b-499f-a410-0778bc1c0f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:37 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96a1816-f80b-499f-a410-0778bc1c0f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-509677207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37ff59ee-2c9b-4eee-9751-6dd8773518ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06457d611bf94a75ad1b883bba7df487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:24:38Z,use_quota=True,user_id='115d7d3efa524a81b5f9bfd8b992d8f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f633fa-7428-4f2e-85c2-ebdeaa8cfc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f633fa-7428-4f2e-85c2-ebdeaa8cfc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f432a425-0c68-4e9b-9f16-3f0578f386a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f432a425-0c68-4e9b-9f16-3f0578f386a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37ff59ee-2c9b-4eee-9751-6dd8773518ae', 'volume_name': 'volume-37ff59ee-2c9b-4eee-9751-6dd8773518ae', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f1e2a82-d59d-499e-901c-37ea77844286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f1e2a82-d59d-499e-901c-37ea77844286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8dbf8bd-50fa-4a43-9bd5-74c61abdc419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:38 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] Volume 37ff59ee-2c9b-4eee-9751-6dd8773518ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37ff59ee-2c9b-4eee-9751-6dd8773518ae', 'volume_size': 1} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:38 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb" returned: 0 in 0.369s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.046s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1403659752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa28ab87-51dd-439f-8294-94b26cd099c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06457d611bf94a75ad1b883bba7df487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:24:37Z,use_quota=True,user_id='115d7d3efa524a81b5f9bfd8b992d8f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] Creating volume aa28ab87-51dd-439f-8294-94b26cd099c6 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:24:38 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-aa28ab87-51dd-439f-8294-94b26cd099c6 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:38 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-aa28ab87-51dd-439f-8294-94b26cd099c6 1073741824 Jul 21 02:24:38 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5401c811-96a5-423d-b546-1d715ccd9d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-412c9fe6-be9c-49da-8620-08181cb16efb', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8948428-60fc-41f5-8cbb-a69357245331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:38 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] Volume volume-412c9fe6-be9c-49da-8620-08181cb16efb (412c9fe6-be9c-49da-8620-08181cb16efb): created successfully Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8948428-60fc-41f5-8cbb-a69357245331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] Flow 'volume_create_manager' (bc6c4e10-6fb9-48e4-8ae3-72f873f377bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] Flow 'volume_create_manager' (1ec1da2b-a1f6-45c7-9a4b-d658327541d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2759982-8f8e-4923-b0b3-f6589afc4f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:38 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-05b13863-6092-4c51-a4f3-ebca3e7742e6 tempest-VolumeDependencyTests-113875028 None] Created volume successfully. Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2759982-8f8e-4923-b0b3-f6589afc4f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1482728347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec45f11-93d6-4186-aab4-aa501fe7019d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06457d611bf94a75ad1b883bba7df487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:24:38Z,use_quota=True,user_id='115d7d3efa524a81b5f9bfd8b992d8f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0de8194a-65ee-4446-a4cd-60f38b242321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0de8194a-65ee-4446-a4cd-60f38b242321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c38b46a1-3160-4389-b6d2-85144c42e94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c38b46a1-3160-4389-b6d2-85144c42e94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ec45f11-93d6-4186-aab4-aa501fe7019d', 'volume_name': 'volume-7ec45f11-93d6-4186-aab4-aa501fe7019d', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ddcc05b-9268-4fb2-82b0-6b1111d6b7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ddcc05b-9268-4fb2-82b0-6b1111d6b7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce0ccae3-313e-4486-b676-00c1db1abf75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:38 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] Volume 7ec45f11-93d6-4186-aab4-aa501fe7019d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ec45f11-93d6-4186-aab4-aa501fe7019d', 'volume_size': 1} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:24:38 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] Flow 'volume_create_manager' (18e51f95-c9f5-4dcf-ad40-b3d3a00176f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd2f8793-5b9d-4007-b02f-bbf899bf9fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-aa28ab87-51dd-439f-8294-94b26cd099c6 1073741824" returned: 0 in 0.571s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd2f8793-5b9d-4007-b02f-bbf899bf9fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1022621560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=996a2ee5-a4ef-4e4c-9ed5-37a8e6d97cba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06457d611bf94a75ad1b883bba7df487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:24:39Z,use_quota=True,user_id='115d7d3efa524a81b5f9bfd8b992d8f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a60ed446-c2f8-4f65-9d53-6676f4bf2a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a60ed446-c2f8-4f65-9d53-6676f4bf2a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fec320fd-311c-4cb4-aa48-9eb31d110a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fec320fd-311c-4cb4-aa48-9eb31d110a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '996a2ee5-a4ef-4e4c-9ed5-37a8e6d97cba', 'volume_name': 'volume-996a2ee5-a4ef-4e4c-9ed5-37a8e6d97cba', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f2e2b5-05e4-4dfa-bd59-8374403c8230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f2e2b5-05e4-4dfa-bd59-8374403c8230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74676fe5-5ef5-4575-8709-e1d286609172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:38 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] Volume 996a2ee5-a4ef-4e4c-9ed5-37a8e6d97cba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-996a2ee5-a4ef-4e4c-9ed5-37a8e6d97cba', 'volume_size': 1} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-aa28ab87-51dd-439f-8294-94b26cd099c6 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:38 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-aa28ab87-51dd-439f-8294-94b26cd099c6 Jul 21 02:24:38 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:39 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-aa28ab87-51dd-439f-8294-94b26cd099c6" returned: 0 in 0.267s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.460s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-213813968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2d7a218-19e6-498b-add4-bc9b1a19dcec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f51ef2d52994a98b517685a68ffab5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:24:37Z,use_quota=True,user_id='44cda6aaa9784b3e97f478fab2914f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Creating volume f2d7a218-19e6-498b-add4-bc9b1a19dcec {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:24:39 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f2d7a218-19e6-498b-add4-bc9b1a19dcec 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:39 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f2d7a218-19e6-498b-add4-bc9b1a19dcec 1073741824 Jul 21 02:24:39 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc749a4-6f8e-47a3-94d4-b0ff99b56d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa28ab87-51dd-439f-8294-94b26cd099c6', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c42f85-e9b7-4451-a861-edac35c73e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:39 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] Volume volume-aa28ab87-51dd-439f-8294-94b26cd099c6 (aa28ab87-51dd-439f-8294-94b26cd099c6): created successfully Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c42f85-e9b7-4451-a861-edac35c73e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] Flow 'volume_create_manager' (c3b5e0c8-af08-4f2b-bb77-01ed25a9514f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2022be96-39b1-4d25-970b-d9fb0f13a093 tempest-VolumeDependencyTests-113875028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:39 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-ae6036b9-5b9a-4a56-85c5-e8db9307a184 tempest-CreateVolumesFromImageTest-132087810 None] Created volume successfully. Jul 21 02:24:39 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f2d7a218-19e6-498b-add4-bc9b1a19dcec 1073741824" returned: 0 in 0.466s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f2d7a218-19e6-498b-add4-bc9b1a19dcec {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:39 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f2d7a218-19e6-498b-add4-bc9b1a19dcec Jul 21 02:24:39 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:39 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f2d7a218-19e6-498b-add4-bc9b1a19dcec" returned: 0 in 0.258s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.121s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1113374368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16f707b0-52c1-4a85-8068-56917486ee76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06457d611bf94a75ad1b883bba7df487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:24:37Z,use_quota=True,user_id='115d7d3efa524a81b5f9bfd8b992d8f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] Creating volume 16f707b0-52c1-4a85-8068-56917486ee76 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:24:39 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-16f707b0-52c1-4a85-8068-56917486ee76 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce12f002-908b-434b-a467-2fc2ea4f3301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2d7a218-19e6-498b-add4-bc9b1a19dcec', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70df81fb-aa9b-409f-b900-27f4a92b5a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:39 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-16f707b0-52c1-4a85-8068-56917486ee76 1073741824 Jul 21 02:24:39 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:39 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Volume volume-f2d7a218-19e6-498b-add4-bc9b1a19dcec (f2d7a218-19e6-498b-add4-bc9b1a19dcec): created successfully Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70df81fb-aa9b-409f-b900-27f4a92b5a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:39 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Flow 'volume_create_manager' (78e260dc-bb12-4de0-9e17-931289cf618a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:39 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-f3a5b9b2-2ff6-428c-8444-285c52d63de8 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Created volume successfully. Jul 21 02:24:40 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-16f707b0-52c1-4a85-8068-56917486ee76 1073741824" returned: 0 in 0.458s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-16f707b0-52c1-4a85-8068-56917486ee76 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:40 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-16f707b0-52c1-4a85-8068-56917486ee76 Jul 21 02:24:40 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:40 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-16f707b0-52c1-4a85-8068-56917486ee76" returned: 0 in 0.286s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:40 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:24:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.601s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:40 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-509677207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37ff59ee-2c9b-4eee-9751-6dd8773518ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06457d611bf94a75ad1b883bba7df487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:24:38Z,use_quota=True,user_id='115d7d3efa524a81b5f9bfd8b992d8f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:24:40 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] Creating volume 37ff59ee-2c9b-4eee-9751-6dd8773518ae {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:24:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:40 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:24:40 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:24:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:40 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:24:40 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:24:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-37ff59ee-2c9b-4eee-9751-6dd8773518ae 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:40 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61220e5a-d6ac-42ff-9563-db760465e9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16f707b0-52c1-4a85-8068-56917486ee76', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:40 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-37ff59ee-2c9b-4eee-9751-6dd8773518ae 1073741824 Jul 21 02:24:40 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:40 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42b85438-b870-4a56-8847-ea75a3b5e64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:40 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] Volume volume-16f707b0-52c1-4a85-8068-56917486ee76 (16f707b0-52c1-4a85-8068-56917486ee76): created successfully Jul 21 02:24:40 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42b85438-b870-4a56-8847-ea75a3b5e64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:40 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] Flow 'volume_create_manager' (807fd3ba-6a4e-4517-90eb-f6b290b1c709) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:40 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-d919233a-6258-4d6a-bd8d-d0d1838a6294 tempest-CreateVolumesFromImageTest-132087810 None] Created volume successfully. Jul 21 02:24:40 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:24:40 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Flow 'volume_create_manager' (a68d7426-cfa7-461c-a017-21fccfc30c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:40 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8885f7e4-603f-4105-b63d-1c4c237e8758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:40 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8885f7e4-603f-4105-b63d-1c4c237e8758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab46328251eb48f6935504aa507f1568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:24:41Z,use_quota=True,user_id='b832c7864ffc47ccb1eaa57741da09e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a83e00eb-6d0c-4a1e-9854-f2e362048de9),volume_type_id=a83e00eb-6d0c-4a1e-9854-f2e362048de9)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:40 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18117fbd-ede7-4be0-ad2f-b64ed36c8616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:40 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18117fbd-ede7-4be0-ad2f-b64ed36c8616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:40 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07360bf2-f190-4f07-b1ec-912fee3c7ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:40 devstack cinder-volume[87566]: DEBUG cinder.image.glance [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Creating Keystone auth plugin from conf {{(pid=87566) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 02:24:40 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Flow 'volume_create_manager' (0963d533-c382-4e26-98a9-081bf8c91cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be937f2-f408-4866-b9b6-aecf0c61b6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be937f2-f408-4866-b9b6-aecf0c61b6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1300035199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c13f072c-da78-4a8a-918c-3602b3f082a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f51ef2d52994a98b517685a68ffab5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:24:41Z,use_quota=True,user_id='44cda6aaa9784b3e97f478fab2914f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4043212b-8af4-40b1-9186-345a4ff1e8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4043212b-8af4-40b1-9186-345a4ff1e8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d537988-b1e1-4c89-8a5d-e73ede2063e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d537988-b1e1-4c89-8a5d-e73ede2063e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c13f072c-da78-4a8a-918c-3602b3f082a0', 'volume_name': 'volume-c13f072c-da78-4a8a-918c-3602b3f082a0', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2280a284-768a-44dc-840d-76a7607ca614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2280a284-768a-44dc-840d-76a7607ca614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d08fba80-8c43-4157-87b9-f0029fc45820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:41 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Volume c13f072c-da78-4a8a-918c-3602b3f082a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c13f072c-da78-4a8a-918c-3602b3f082a0', 'volume_size': 1} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:41 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-37ff59ee-2c9b-4eee-9751-6dd8773518ae 1073741824" returned: 0 in 0.567s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-37ff59ee-2c9b-4eee-9751-6dd8773518ae {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:41 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-37ff59ee-2c9b-4eee-9751-6dd8773518ae Jul 21 02:24:41 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07360bf2-f190-4f07-b1ec-912fee3c7ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3', 'volume_name': 'volume-4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3', 'volume_size': 1, 'image_id': '3d1844dc-8ba1-47df-9556-8b164518df34', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d1844dc-8ba1-47df-9556-8b164518df34', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2fa4743c740ca372851ecae6e2037a1e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ab46328251eb48f6935504aa507f1568', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '046737eb35e8c677127f2b75a750feb4676f184be5cdba35da750c457231e476ba795605d0fb856edd56849fa424e7257d9d38d9a42b7293679e74ab1baa256f', 'id': '3d1844dc-8ba1-47df-9556-8b164518df34', 'created_at': datetime.datetime(2026, 7, 21, 0, 24, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 0, 24, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d1844dc-8ba1-47df-9556-8b164518df34/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cedee19-34f4-40ca-b4ee-9f0670c7b9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cedee19-34f4-40ca-b4ee-9f0670c7b9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcaa23ad-4b92-44d3-800e-36d3002edb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:41 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Volume 4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3', 'volume_size': 1, 'image_id': '3d1844dc-8ba1-47df-9556-8b164518df34', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d1844dc-8ba1-47df-9556-8b164518df34', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2fa4743c740ca372851ecae6e2037a1e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ab46328251eb48f6935504aa507f1568', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '046737eb35e8c677127f2b75a750feb4676f184be5cdba35da750c457231e476ba795605d0fb856edd56849fa424e7257d9d38d9a42b7293679e74ab1baa256f', 'id': '3d1844dc-8ba1-47df-9556-8b164518df34', 'created_at': datetime.datetime(2026, 7, 21, 0, 24, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 0, 24, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d1844dc-8ba1-47df-9556-8b164518df34/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Trying to clone 4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3 from image 3d1844dc-8ba1-47df-9556-8b164518df34 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3d1844dc-8ba1-47df-9556-8b164518df34', 'metadata': {}}]). {{(pid=87566) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Flow 'volume_create_manager' (4bd8d1ff-6ec6-4304-b633-4ebafa019b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9537d570-5351-4f58-a04b-95377e253606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9537d570-5351-4f58-a04b-95377e253606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-497205950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d56d0aba-6644-4607-9ac2-bf5ed1269128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f51ef2d52994a98b517685a68ffab5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:24:41Z,use_quota=True,user_id='44cda6aaa9784b3e97f478fab2914f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9b9fda-48cc-432a-bd54-d3532ec60890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9b9fda-48cc-432a-bd54-d3532ec60890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef2ed38e-fae5-4272-bf8e-af1766dd27a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef2ed38e-fae5-4272-bf8e-af1766dd27a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd56d0aba-6644-4607-9ac2-bf5ed1269128', 'volume_name': 'volume-d56d0aba-6644-4607-9ac2-bf5ed1269128', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bffa7595-8f6d-4653-86eb-3ac9c0516d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bffa7595-8f6d-4653-86eb-3ac9c0516d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa56ded-940b-43f3-a919-13be16f4b5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:41 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Volume d56d0aba-6644-4607-9ac2-bf5ed1269128: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d56d0aba-6644-4607-9ac2-bf5ed1269128', 'volume_size': 1} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:41 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-37ff59ee-2c9b-4eee-9751-6dd8773518ae" returned: 0 in 0.305s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.257s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1482728347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec45f11-93d6-4186-aab4-aa501fe7019d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06457d611bf94a75ad1b883bba7df487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:24:38Z,use_quota=True,user_id='115d7d3efa524a81b5f9bfd8b992d8f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] Creating volume 7ec45f11-93d6-4186-aab4-aa501fe7019d {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:24:41 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7ec45f11-93d6-4186-aab4-aa501fe7019d 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3d1844dc-8ba1-47df-9556-8b164518df34_5cuyo8mydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87566) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 02:24:41 devstack cinder-volume[87566]: INFO cinder.image.image_utils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Image download 0.00 MB at 0.00 MB/s Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8dbf8bd-50fa-4a43-9bd5-74c61abdc419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37ff59ee-2c9b-4eee-9751-6dd8773518ae', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:41 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7ec45f11-93d6-4186-aab4-aa501fe7019d 1073741824 Jul 21 02:24:41 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb78381-0db6-4fef-9c35-e09d0123c6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:41 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] Volume volume-37ff59ee-2c9b-4eee-9751-6dd8773518ae (37ff59ee-2c9b-4eee-9751-6dd8773518ae): created successfully Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb78381-0db6-4fef-9c35-e09d0123c6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] Flow 'volume_create_manager' (88bc2c04-75c9-40b1-aab8-72dbceb8e2d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb32660-e96b-4416-ada7-6618ddfa2b1b]: (4, 'raw') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:24:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d1844dc-8ba1-47df-9556-8b164518df34_5cuyo8mydevstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:41 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-a57c91f6-e5e7-4827-a2b1-0f1062796cdf tempest-CreateVolumesFromImageTest-132087810 None] Created volume successfully. Jul 21 02:24:41 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d1844dc-8ba1-47df-9556-8b164518df34_5cuyo8mydevstack@QuobyteHD Jul 21 02:24:41 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Flow 'volume_create_manager' (120cfa4d-43b5-4dec-b700-a8ef4c67882e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7877f1f6-7d26-4eca-a716-c071859e52fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7877f1f6-7d26-4eca-a716-c071859e52fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1491823536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e3b67dd-d58e-433a-a7d3-7a81edffb3d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f51ef2d52994a98b517685a68ffab5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:24:42Z,use_quota=True,user_id='44cda6aaa9784b3e97f478fab2914f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5272fe01-4175-4e94-ae86-4b27762c5201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5272fe01-4175-4e94-ae86-4b27762c5201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a64b08-ce66-42ea-bfc4-fe280fe26236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a64b08-ce66-42ea-bfc4-fe280fe26236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e3b67dd-d58e-433a-a7d3-7a81edffb3d3', 'volume_name': 'volume-1e3b67dd-d58e-433a-a7d3-7a81edffb3d3', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f7859aa-2337-4a96-9e26-0b557c91f07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f7859aa-2337-4a96-9e26-0b557c91f07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:42 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b585fcb-85f9-4453-aa14-5ce5ff03bb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:42 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Volume 1e3b67dd-d58e-433a-a7d3-7a81edffb3d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e3b67dd-d58e-433a-a7d3-7a81edffb3d3', 'volume_size': 1} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d1844dc-8ba1-47df-9556-8b164518df34_5cuyo8mydevstack@QuobyteHD" returned: 0 in 0.512s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d1844dc-8ba1-47df-9556-8b164518df34_5cuyo8mydevstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:42 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7ec45f11-93d6-4186-aab4-aa501fe7019d 1073741824" returned: 0 in 0.630s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7ec45f11-93d6-4186-aab4-aa501fe7019d {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:42 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7ec45f11-93d6-4186-aab4-aa501fe7019d Jul 21 02:24:42 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:42 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d1844dc-8ba1-47df-9556-8b164518df34_5cuyo8mydevstack@QuobyteHD Jul 21 02:24:42 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Flow 'volume_create_manager' (d25ef512-31df-4036-bde3-c7d4b4456826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (823b2c96-1be4-4d9c-8062-f966aa0239a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (823b2c96-1be4-4d9c-8062-f966aa0239a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1901048170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7c64dc9-13ec-4ceb-af0b-78a8bf6551df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f51ef2d52994a98b517685a68ffab5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:24:42Z,use_quota=True,user_id='44cda6aaa9784b3e97f478fab2914f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba8ca704-db9f-4cb1-9f5f-9ed6d6255815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba8ca704-db9f-4cb1-9f5f-9ed6d6255815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46293073-e266-4b7e-98af-6830f2536e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46293073-e266-4b7e-98af-6830f2536e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7c64dc9-13ec-4ceb-af0b-78a8bf6551df', 'volume_name': 'volume-e7c64dc9-13ec-4ceb-af0b-78a8bf6551df', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c5b5f77-43f4-46bc-bafc-428d1e805f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c5b5f77-43f4-46bc-bafc-428d1e805f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596bd378-d101-47d3-9265-d62b37807fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:42 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Volume e7c64dc9-13ec-4ceb-af0b-78a8bf6551df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7c64dc9-13ec-4ceb-af0b-78a8bf6551df', 'volume_size': 1} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:42 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7ec45f11-93d6-4186-aab4-aa501fe7019d" returned: 0 in 0.331s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.847s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1022621560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=996a2ee5-a4ef-4e4c-9ed5-37a8e6d97cba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06457d611bf94a75ad1b883bba7df487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:24:39Z,use_quota=True,user_id='115d7d3efa524a81b5f9bfd8b992d8f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] Creating volume 996a2ee5-a4ef-4e4c-9ed5-37a8e6d97cba {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:24:42 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-996a2ee5-a4ef-4e4c-9ed5-37a8e6d97cba 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:42 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:42 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-996a2ee5-a4ef-4e4c-9ed5-37a8e6d97cba 1073741824 Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce0ccae3-313e-4486-b676-00c1db1abf75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ec45f11-93d6-4186-aab4-aa501fe7019d', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:42 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae5027eb-f97a-498b-9e46-94676bdda68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d1844dc-8ba1-47df-9556-8b164518df34_5cuyo8mydevstack@QuobyteHD" returned: 1 in 0.463s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d1844dc-8ba1-47df-9556-8b164518df34_5cuyo8mydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Temporary image 3d1844dc-8ba1-47df-9556-8b164518df34 is fetched for user b832c7864ffc47ccb1eaa57741da09e4. {{(pid=87566) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 02:24:42 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] Volume volume-7ec45f11-93d6-4186-aab4-aa501fe7019d (7ec45f11-93d6-4186-aab4-aa501fe7019d): created successfully Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae5027eb-f97a-498b-9e46-94676bdda68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] Flow 'volume_create_manager' (1ec1da2b-a1f6-45c7-9a4b-d658327541d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:42 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-f4ee5dce-15bf-4b3f-9425-a46b2f107128 tempest-CreateVolumesFromImageTest-132087810 None] Created volume successfully. Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b19bdf8-c067-4045-9bb5-d678215a178d]: (4, 'raw') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d1844dc-8ba1-47df-9556-8b164518df34_5cuyo8mydevstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:24:42 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d1844dc-8ba1-47df-9556-8b164518df34_5cuyo8mydevstack@QuobyteHD Jul 21 02:24:42 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Flow 'volume_create_manager' (19c4a00a-5840-4507-8a3c-bdcafd97d377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a7f4f1d-c1a1-4f5b-8696-75155d424a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a7f4f1d-c1a1-4f5b-8696-75155d424a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1597623616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4092281-3261-40f2-a4b7-9b08094da1e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f51ef2d52994a98b517685a68ffab5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:24:43Z,use_quota=True,user_id='44cda6aaa9784b3e97f478fab2914f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af72cc83-1341-449b-9e31-b13699b37aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af72cc83-1341-449b-9e31-b13699b37aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33eac0db-6820-463f-85a8-8bc56aa1c530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33eac0db-6820-463f-85a8-8bc56aa1c530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4092281-3261-40f2-a4b7-9b08094da1e6', 'volume_name': 'volume-b4092281-3261-40f2-a4b7-9b08094da1e6', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c89517d-51a1-4b9f-b155-4f5cce2ed18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c89517d-51a1-4b9f-b155-4f5cce2ed18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a11d3b3-6f87-4dac-ba69-0529038c15b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:42 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Volume b4092281-3261-40f2-a4b7-9b08094da1e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4092281-3261-40f2-a4b7-9b08094da1e6', 'volume_size': 1} Jul 21 02:24:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:43 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:43 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d1844dc-8ba1-47df-9556-8b164518df34_5cuyo8mydevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d1844dc-8ba1-47df-9556-8b164518df34_5cuyo8mydevstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-996a2ee5-a4ef-4e4c-9ed5-37a8e6d97cba 1073741824" returned: 0 in 0.534s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-996a2ee5-a4ef-4e4c-9ed5-37a8e6d97cba {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:43 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-996a2ee5-a4ef-4e4c-9ed5-37a8e6d97cba Jul 21 02:24:43 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:43 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d1844dc-8ba1-47df-9556-8b164518df34_5cuyo8mydevstack@QuobyteHD Jul 21 02:24:43 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:43 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-996a2ee5-a4ef-4e4c-9ed5-37a8e6d97cba" returned: 0 in 0.252s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:43 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:24:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2022be96-39b1-4d25-970b-d9fb0f13a093 tempest-VolumeDependencyTests-113875028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.285s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:43 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74676fe5-5ef5-4575-8709-e1d286609172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-996a2ee5-a4ef-4e4c-9ed5-37a8e6d97cba', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:43 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fef21db-93ab-4e06-bc9b-2b1bce28cc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:43 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:43 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-2022be96-39b1-4d25-970b-d9fb0f13a093 tempest-VolumeDependencyTests-113875028 None] Creating offline snapshot 6b427ac9-2dd8-438c-8696-7a3226e1c58c of volume 412c9fe6-be9c-49da-8620-08181cb16efb {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:24:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d1844dc-8ba1-47df-9556-8b164518df34_5cuyo8mydevstack@QuobyteHD" returned: 1 in 0.349s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d1844dc-8ba1-47df-9556-8b164518df34_5cuyo8mydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 02:24:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:43 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] Volume volume-996a2ee5-a4ef-4e4c-9ed5-37a8e6d97cba (996a2ee5-a4ef-4e4c-9ed5-37a8e6d97cba): created successfully Jul 21 02:24:43 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fef21db-93ab-4e06-bc9b-2b1bce28cc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:43 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] Flow 'volume_create_manager' (18e51f95-c9f5-4dcf-ad40-b3d3a00176f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:43 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[4221bf95-f495-4a9e-acd4-f0d55ad733e3]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:24:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2022be96-39b1-4d25-970b-d9fb0f13a093 tempest-VolumeDependencyTests-113875028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:43 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-3e1790f3-b1cd-4183-bc0c-759ac7b3c0e1 tempest-CreateVolumesFromImageTest-132087810 None] Created volume successfully. Jul 21 02:24:43 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb Jul 21 02:24:43 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:43 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2022be96-39b1-4d25-970b-d9fb0f13a093 tempest-VolumeDependencyTests-113875028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb" returned: 0 in 0.355s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2022be96-39b1-4d25-970b-d9fb0f13a093 tempest-VolumeDependencyTests-113875028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb.6b427ac9-2dd8-438c-8696-7a3226e1c58c 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:43 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb.6b427ac9-2dd8-438c-8696-7a3226e1c58c 1G Jul 21 02:24:43 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:44 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:44 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b1bba2c7-8368-4542-b578-e2c0f7c7088e tempest-CreateVolumesFromImageTest-132087810 None] Acquiring lock "cinder-996a2ee5-a4ef-4e4c-9ed5-37a8e6d97cba-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2022be96-39b1-4d25-970b-d9fb0f13a093 tempest-VolumeDependencyTests-113875028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb.6b427ac9-2dd8-438c-8696-7a3226e1c58c 1G" returned: 0 in 0.409s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2022be96-39b1-4d25-970b-d9fb0f13a093 tempest-VolumeDependencyTests-113875028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-412c9fe6-be9c-49da-8620-08181cb16efb -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb.6b427ac9-2dd8-438c-8696-7a3226e1c58c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:44 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b1bba2c7-8368-4542-b578-e2c0f7c7088e tempest-CreateVolumesFromImageTest-132087810 None] Lock "cinder-996a2ee5-a4ef-4e4c-9ed5-37a8e6d97cba-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:44 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-412c9fe6-be9c-49da-8620-08181cb16efb -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb.6b427ac9-2dd8-438c-8696-7a3226e1c58c Jul 21 02:24:44 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:44 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b1bba2c7-8368-4542-b578-e2c0f7c7088e tempest-CreateVolumesFromImageTest-132087810 None] Acquiring lock "cinder-quobyte-996a2ee5-a4ef-4e4c-9ed5-37a8e6d97cba" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:44 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b1bba2c7-8368-4542-b578-e2c0f7c7088e tempest-CreateVolumesFromImageTest-132087810 None] Lock "cinder-quobyte-996a2ee5-a4ef-4e4c-9ed5-37a8e6d97cba" acquired by "delete_volume" :: waited 0.017s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:44 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[691a38ee-cf31-4b97-af41-30c4cdfdb87e]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:24:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b1bba2c7-8368-4542-b578-e2c0f7c7088e tempest-CreateVolumesFromImageTest-132087810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-996a2ee5-a4ef-4e4c-9ed5-37a8e6d97cba {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:44 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-996a2ee5-a4ef-4e4c-9ed5-37a8e6d97cba Jul 21 02:24:44 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:44 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2022be96-39b1-4d25-970b-d9fb0f13a093 tempest-VolumeDependencyTests-113875028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-412c9fe6-be9c-49da-8620-08181cb16efb -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb.6b427ac9-2dd8-438c-8696-7a3226e1c58c" returned: 0 in 0.310s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:44 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-2022be96-39b1-4d25-970b-d9fb0f13a093 tempest-VolumeDependencyTests-113875028 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb.6b427ac9-2dd8-438c-8696-7a3226e1c58c is being set with open permissions: ugo+rw Jul 21 02:24:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2022be96-39b1-4d25-970b-d9fb0f13a093 tempest-VolumeDependencyTests-113875028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb.6b427ac9-2dd8-438c-8696-7a3226e1c58c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:44 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb.6b427ac9-2dd8-438c-8696-7a3226e1c58c Jul 21 02:24:44 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:44 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b1bba2c7-8368-4542-b578-e2c0f7c7088e tempest-CreateVolumesFromImageTest-132087810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-996a2ee5-a4ef-4e4c-9ed5-37a8e6d97cba" returned: 0 in 0.360s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b1bba2c7-8368-4542-b578-e2c0f7c7088e tempest-CreateVolumesFromImageTest-132087810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-996a2ee5-a4ef-4e4c-9ed5-37a8e6d97cba {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:44 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-996a2ee5-a4ef-4e4c-9ed5-37a8e6d97cba Jul 21 02:24:44 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:44 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2022be96-39b1-4d25-970b-d9fb0f13a093 tempest-VolumeDependencyTests-113875028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb.6b427ac9-2dd8-438c-8696-7a3226e1c58c" returned: 0 in 0.267s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2022be96-39b1-4d25-970b-d9fb0f13a093 tempest-VolumeDependencyTests-113875028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:44 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb.info Jul 21 02:24:44 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:45 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b1bba2c7-8368-4542-b578-e2c0f7c7088e tempest-CreateVolumesFromImageTest-132087810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-996a2ee5-a4ef-4e4c-9ed5-37a8e6d97cba" returned: 0 in 0.272s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b1bba2c7-8368-4542-b578-e2c0f7c7088e tempest-CreateVolumesFromImageTest-132087810 None] Lock "cinder-quobyte-996a2ee5-a4ef-4e4c-9ed5-37a8e6d97cba" released by "delete_volume" :: held 0.675s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-b1bba2c7-8368-4542-b578-e2c0f7c7088e tempest-CreateVolumesFromImageTest-132087810 None] Created reservations ['c7377246-30cb-4a13-806f-433416462a74', '13d5f909-d01b-4171-85af-49f6fdfc8f57', '049f10d7-afaa-42bb-8e16-e03356226c9b', '67124e4a-0aee-48e1-8c5e-3ee827697720'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:24:45 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2022be96-39b1-4d25-970b-d9fb0f13a093 tempest-VolumeDependencyTests-113875028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb.info" returned: 0 in 0.260s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:45 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-2022be96-39b1-4d25-970b-d9fb0f13a093 tempest-VolumeDependencyTests-113875028 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb.info is being set with open permissions: ugo+rw Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2022be96-39b1-4d25-970b-d9fb0f13a093 tempest-VolumeDependencyTests-113875028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b1bba2c7-8368-4542-b578-e2c0f7c7088e tempest-CreateVolumesFromImageTest-132087810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b1bba2c7-8368-4542-b578-e2c0f7c7088e tempest-CreateVolumesFromImageTest-132087810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b1bba2c7-8368-4542-b578-e2c0f7c7088e tempest-CreateVolumesFromImageTest-132087810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:24:45 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb.info Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b1bba2c7-8368-4542-b578-e2c0f7c7088e tempest-CreateVolumesFromImageTest-132087810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b1bba2c7-8368-4542-b578-e2c0f7c7088e tempest-CreateVolumesFromImageTest-132087810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b1bba2c7-8368-4542-b578-e2c0f7c7088e tempest-CreateVolumesFromImageTest-132087810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:45 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:45 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:24:45 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:45 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2022be96-39b1-4d25-970b-d9fb0f13a093 tempest-VolumeDependencyTests-113875028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb.info" returned: 0 in 0.256s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2022be96-39b1-4d25-970b-d9fb0f13a093 tempest-VolumeDependencyTests-113875028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.983s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.345s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1300035199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c13f072c-da78-4a8a-918c-3602b3f082a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f51ef2d52994a98b517685a68ffab5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:24:41Z,use_quota=True,user_id='44cda6aaa9784b3e97f478fab2914f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Creating volume c13f072c-da78-4a8a-918c-3602b3f082a0 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:24:45 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c13f072c-da78-4a8a-918c-3602b3f082a0 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:45 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d6d8a37c-65ff-4ca9-abcf-eeaad1e94e9d tempest-CreateVolumesFromImageTest-132087810 None] Acquiring lock "cinder-7ec45f11-93d6-4186-aab4-aa501fe7019d-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:45 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c13f072c-da78-4a8a-918c-3602b3f082a0 1073741824 Jul 21 02:24:45 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b1bba2c7-8368-4542-b578-e2c0f7c7088e tempest-CreateVolumesFromImageTest-132087810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.301s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-b1bba2c7-8368-4542-b578-e2c0f7c7088e tempest-CreateVolumesFromImageTest-132087810 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:24:45 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-b1bba2c7-8368-4542-b578-e2c0f7c7088e tempest-CreateVolumesFromImageTest-132087810 None] Deleted volume successfully. Jul 21 02:24:45 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-2022be96-39b1-4d25-970b-d9fb0f13a093 tempest-VolumeDependencyTests-113875028 None] Create snapshot completed successfully Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d6d8a37c-65ff-4ca9-abcf-eeaad1e94e9d tempest-CreateVolumesFromImageTest-132087810 None] Lock "cinder-7ec45f11-93d6-4186-aab4-aa501fe7019d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b1bba2c7-8368-4542-b578-e2c0f7c7088e tempest-CreateVolumesFromImageTest-132087810 None] Lock "cinder-996a2ee5-a4ef-4e4c-9ed5-37a8e6d97cba-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d6d8a37c-65ff-4ca9-abcf-eeaad1e94e9d tempest-CreateVolumesFromImageTest-132087810 None] Acquiring lock "cinder-quobyte-7ec45f11-93d6-4186-aab4-aa501fe7019d" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d6d8a37c-65ff-4ca9-abcf-eeaad1e94e9d tempest-CreateVolumesFromImageTest-132087810 None] Lock "cinder-quobyte-7ec45f11-93d6-4186-aab4-aa501fe7019d" acquired by "delete_volume" :: waited 0.018s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98239c1-868c-4c54-a566-64aa58461a3a]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d6d8a37c-65ff-4ca9-abcf-eeaad1e94e9d tempest-CreateVolumesFromImageTest-132087810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7ec45f11-93d6-4186-aab4-aa501fe7019d {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:45 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7ec45f11-93d6-4186-aab4-aa501fe7019d Jul 21 02:24:45 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:45 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c13f072c-da78-4a8a-918c-3602b3f082a0 1073741824" returned: 0 in 0.477s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:45 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d6d8a37c-65ff-4ca9-abcf-eeaad1e94e9d tempest-CreateVolumesFromImageTest-132087810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7ec45f11-93d6-4186-aab4-aa501fe7019d" returned: 0 in 0.399s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d6d8a37c-65ff-4ca9-abcf-eeaad1e94e9d tempest-CreateVolumesFromImageTest-132087810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7ec45f11-93d6-4186-aab4-aa501fe7019d {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c13f072c-da78-4a8a-918c-3602b3f082a0 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:46 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7ec45f11-93d6-4186-aab4-aa501fe7019d Jul 21 02:24:46 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:46 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c13f072c-da78-4a8a-918c-3602b3f082a0 Jul 21 02:24:46 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:46 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d6d8a37c-65ff-4ca9-abcf-eeaad1e94e9d tempest-CreateVolumesFromImageTest-132087810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7ec45f11-93d6-4186-aab4-aa501fe7019d" returned: 0 in 0.250s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:46 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d6d8a37c-65ff-4ca9-abcf-eeaad1e94e9d tempest-CreateVolumesFromImageTest-132087810 None] Lock "cinder-quobyte-7ec45f11-93d6-4186-aab4-aa501fe7019d" released by "delete_volume" :: held 0.690s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c13f072c-da78-4a8a-918c-3602b3f082a0" returned: 0 in 0.248s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.692s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-497205950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d56d0aba-6644-4607-9ac2-bf5ed1269128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f51ef2d52994a98b517685a68ffab5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:24:41Z,use_quota=True,user_id='44cda6aaa9784b3e97f478fab2914f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Creating volume d56d0aba-6644-4607-9ac2-bf5ed1269128 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:24:46 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d56d0aba-6644-4607-9ac2-bf5ed1269128 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:46 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d56d0aba-6644-4607-9ac2-bf5ed1269128 1073741824 Jul 21 02:24:46 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d08fba80-8c43-4157-87b9-f0029fc45820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c13f072c-da78-4a8a-918c-3602b3f082a0', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b53b53-cb44-43f3-8820-81691252260a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:46 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Volume volume-c13f072c-da78-4a8a-918c-3602b3f082a0 (c13f072c-da78-4a8a-918c-3602b3f082a0): created successfully Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b53b53-cb44-43f3-8820-81691252260a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Flow 'volume_create_manager' (0963d533-c382-4e26-98a9-081bf8c91cdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:46 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-27809475-16b9-478c-8e53-baeec0f3ab17 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Created volume successfully. Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-d6d8a37c-65ff-4ca9-abcf-eeaad1e94e9d tempest-CreateVolumesFromImageTest-132087810 None] Created reservations ['81a4c483-c73d-4cdf-950a-805622421a17', '137d692f-dce0-4357-bc9e-60a88851e13f', '5fffff64-4375-4d1a-8b60-3a72d067a302', '9c749f72-e0bf-469e-b03e-e1479de17b06'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d6d8a37c-65ff-4ca9-abcf-eeaad1e94e9d tempest-CreateVolumesFromImageTest-132087810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d6d8a37c-65ff-4ca9-abcf-eeaad1e94e9d tempest-CreateVolumesFromImageTest-132087810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d6d8a37c-65ff-4ca9-abcf-eeaad1e94e9d tempest-CreateVolumesFromImageTest-132087810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d6d8a37c-65ff-4ca9-abcf-eeaad1e94e9d tempest-CreateVolumesFromImageTest-132087810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d6d8a37c-65ff-4ca9-abcf-eeaad1e94e9d tempest-CreateVolumesFromImageTest-132087810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d6d8a37c-65ff-4ca9-abcf-eeaad1e94e9d tempest-CreateVolumesFromImageTest-132087810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:46 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:24:46 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d71b5aec-36b7-4bcc-8434-430978e5a21d tempest-CreateVolumesFromImageTest-132087810 None] Acquiring lock "cinder-37ff59ee-2c9b-4eee-9751-6dd8773518ae-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d71b5aec-36b7-4bcc-8434-430978e5a21d tempest-CreateVolumesFromImageTest-132087810 None] Lock "cinder-37ff59ee-2c9b-4eee-9751-6dd8773518ae-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d71b5aec-36b7-4bcc-8434-430978e5a21d tempest-CreateVolumesFromImageTest-132087810 None] Acquiring lock "cinder-quobyte-37ff59ee-2c9b-4eee-9751-6dd8773518ae" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d71b5aec-36b7-4bcc-8434-430978e5a21d tempest-CreateVolumesFromImageTest-132087810 None] Lock "cinder-quobyte-37ff59ee-2c9b-4eee-9751-6dd8773518ae" acquired by "delete_volume" :: waited 0.029s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f09d8a-c424-499a-8664-6b6cf7666278]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d71b5aec-36b7-4bcc-8434-430978e5a21d tempest-CreateVolumesFromImageTest-132087810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-37ff59ee-2c9b-4eee-9751-6dd8773518ae {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:46 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d6d8a37c-65ff-4ca9-abcf-eeaad1e94e9d tempest-CreateVolumesFromImageTest-132087810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.305s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-d6d8a37c-65ff-4ca9-abcf-eeaad1e94e9d tempest-CreateVolumesFromImageTest-132087810 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:24:46 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-d6d8a37c-65ff-4ca9-abcf-eeaad1e94e9d tempest-CreateVolumesFromImageTest-132087810 None] Deleted volume successfully. Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d6d8a37c-65ff-4ca9-abcf-eeaad1e94e9d tempest-CreateVolumesFromImageTest-132087810 None] Lock "cinder-7ec45f11-93d6-4186-aab4-aa501fe7019d-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:24:46 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d56d0aba-6644-4607-9ac2-bf5ed1269128 1073741824" returned: 0 in 0.551s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d56d0aba-6644-4607-9ac2-bf5ed1269128 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:46 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-37ff59ee-2c9b-4eee-9751-6dd8773518ae Jul 21 02:24:46 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:46 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d56d0aba-6644-4607-9ac2-bf5ed1269128 Jul 21 02:24:46 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Flow 'volume_create_manager' (a401f7b6-f5fb-4c58-930e-2471d54da8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5524fc57-1228-4e24-9a91-248b449352ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5524fc57-1228-4e24-9a91-248b449352ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1742641049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaa893c0-70b9-4062-9373-10feac406699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b95510ba4042559dce28e234f89586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6b427ac9-2dd8-438c-8696-7a3226e1c58c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:24:47Z,use_quota=True,user_id='9f959e8a09cb4d3cb414843c26f9ac39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2144385d-da82-47ca-b244-3abff9cfc686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:47 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2144385d-da82-47ca-b244-3abff9cfc686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8326db2a-2a46-45b8-98b5-c86ab7eefe7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:47 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8326db2a-2a46-45b8-98b5-c86ab7eefe7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'eaa893c0-70b9-4062-9373-10feac406699', 'volume_name': 'volume-eaa893c0-70b9-4062-9373-10feac406699', 'volume_size': 1, 'snapshot_id': '6b427ac9-2dd8-438c-8696-7a3226e1c58c'}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd365c0a-2489-4660-90ee-64b812f6e268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd365c0a-2489-4660-90ee-64b812f6e268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14e4afbc-7d7f-425c-9f5b-4ff1619b2224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:47 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Volume eaa893c0-70b9-4062-9373-10feac406699: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-eaa893c0-70b9-4062-9373-10feac406699', 'volume_size': 1, 'snapshot_id': '6b427ac9-2dd8-438c-8696-7a3226e1c58c'} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d71b5aec-36b7-4bcc-8434-430978e5a21d tempest-CreateVolumesFromImageTest-132087810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-37ff59ee-2c9b-4eee-9751-6dd8773518ae" returned: 0 in 0.467s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d56d0aba-6644-4607-9ac2-bf5ed1269128" returned: 0 in 0.340s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d71b5aec-36b7-4bcc-8434-430978e5a21d tempest-CreateVolumesFromImageTest-132087810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-37ff59ee-2c9b-4eee-9751-6dd8773518ae {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:47 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-37ff59ee-2c9b-4eee-9751-6dd8773518ae Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.031s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:47 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1491823536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e3b67dd-d58e-433a-a7d3-7a81edffb3d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f51ef2d52994a98b517685a68ffab5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:24:42Z,use_quota=True,user_id='44cda6aaa9784b3e97f478fab2914f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Creating volume 1e3b67dd-d58e-433a-a7d3-7a81edffb3d3 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:24:47 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1e3b67dd-d58e-433a-a7d3-7a81edffb3d3 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:47 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1e3b67dd-d58e-433a-a7d3-7a81edffb3d3 1073741824 Jul 21 02:24:47 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa56ded-940b-43f3-a919-13be16f4b5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d56d0aba-6644-4607-9ac2-bf5ed1269128', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (673f6949-c4b3-49d2-9d78-f5427a3705d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:47 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Volume volume-d56d0aba-6644-4607-9ac2-bf5ed1269128 (d56d0aba-6644-4607-9ac2-bf5ed1269128): created successfully Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (673f6949-c4b3-49d2-9d78-f5427a3705d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Flow 'volume_create_manager' (4bd8d1ff-6ec6-4304-b633-4ebafa019b32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:47 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-77333a78-dc80-495c-ba19-1875f82c007d tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Created volume successfully. Jul 21 02:24:47 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d71b5aec-36b7-4bcc-8434-430978e5a21d tempest-CreateVolumesFromImageTest-132087810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-37ff59ee-2c9b-4eee-9751-6dd8773518ae" returned: 0 in 0.251s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d71b5aec-36b7-4bcc-8434-430978e5a21d tempest-CreateVolumesFromImageTest-132087810 None] Lock "cinder-quobyte-37ff59ee-2c9b-4eee-9751-6dd8773518ae" released by "delete_volume" :: held 0.759s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-d71b5aec-36b7-4bcc-8434-430978e5a21d tempest-CreateVolumesFromImageTest-132087810 None] Created reservations ['e47506c9-8381-4262-926e-9e6215a15c3f', '5095cd1b-6bae-483e-8a04-c1db8ffe7d02', '9260411b-f6f9-45c9-ad82-40aa28ccb3b2', '5ba29679-a36c-4eb7-aa88-32045c1c249b'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d71b5aec-36b7-4bcc-8434-430978e5a21d tempest-CreateVolumesFromImageTest-132087810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d71b5aec-36b7-4bcc-8434-430978e5a21d tempest-CreateVolumesFromImageTest-132087810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d71b5aec-36b7-4bcc-8434-430978e5a21d tempest-CreateVolumesFromImageTest-132087810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d71b5aec-36b7-4bcc-8434-430978e5a21d tempest-CreateVolumesFromImageTest-132087810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d71b5aec-36b7-4bcc-8434-430978e5a21d tempest-CreateVolumesFromImageTest-132087810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d71b5aec-36b7-4bcc-8434-430978e5a21d tempest-CreateVolumesFromImageTest-132087810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:47 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:24:47 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:47 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1e3b67dd-d58e-433a-a7d3-7a81edffb3d3 1073741824" returned: 0 in 0.436s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1e3b67dd-d58e-433a-a7d3-7a81edffb3d3 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:47 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1e3b67dd-d58e-433a-a7d3-7a81edffb3d3 Jul 21 02:24:47 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-343e07f5-0bfd-4ea1-8c2e-f768434927cf tempest-CreateVolumesFromImageTest-132087810 None] Acquiring lock "cinder-16f707b0-52c1-4a85-8068-56917486ee76-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-343e07f5-0bfd-4ea1-8c2e-f768434927cf tempest-CreateVolumesFromImageTest-132087810 None] Lock "cinder-16f707b0-52c1-4a85-8068-56917486ee76-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-343e07f5-0bfd-4ea1-8c2e-f768434927cf tempest-CreateVolumesFromImageTest-132087810 None] Acquiring lock "cinder-quobyte-16f707b0-52c1-4a85-8068-56917486ee76" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:47 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-343e07f5-0bfd-4ea1-8c2e-f768434927cf tempest-CreateVolumesFromImageTest-132087810 None] Lock "cinder-quobyte-16f707b0-52c1-4a85-8068-56917486ee76" acquired by "delete_volume" :: waited 0.014s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d71b5aec-36b7-4bcc-8434-430978e5a21d tempest-CreateVolumesFromImageTest-132087810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.311s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-d71b5aec-36b7-4bcc-8434-430978e5a21d tempest-CreateVolumesFromImageTest-132087810 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:24:47 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-d71b5aec-36b7-4bcc-8434-430978e5a21d tempest-CreateVolumesFromImageTest-132087810 None] Deleted volume successfully. Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e05f05d-1622-4855-bbfe-451f236fb3e2]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-343e07f5-0bfd-4ea1-8c2e-f768434927cf tempest-CreateVolumesFromImageTest-132087810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-16f707b0-52c1-4a85-8068-56917486ee76 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d71b5aec-36b7-4bcc-8434-430978e5a21d tempest-CreateVolumesFromImageTest-132087810 None] Lock "cinder-37ff59ee-2c9b-4eee-9751-6dd8773518ae-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:24:47 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1e3b67dd-d58e-433a-a7d3-7a81edffb3d3" returned: 0 in 0.284s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.436s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1901048170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7c64dc9-13ec-4ceb-af0b-78a8bf6551df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f51ef2d52994a98b517685a68ffab5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:24:42Z,use_quota=True,user_id='44cda6aaa9784b3e97f478fab2914f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Creating volume e7c64dc9-13ec-4ceb-af0b-78a8bf6551df {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:24:48 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e7c64dc9-13ec-4ceb-af0b-78a8bf6551df 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:48 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-16f707b0-52c1-4a85-8068-56917486ee76 Jul 21 02:24:48 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b585fcb-85f9-4453-aa14-5ce5ff03bb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e3b67dd-d58e-433a-a7d3-7a81edffb3d3', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1410588d-b09a-4685-901c-50eb147c4ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:48 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e7c64dc9-13ec-4ceb-af0b-78a8bf6551df 1073741824 Jul 21 02:24:48 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:48 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Volume volume-1e3b67dd-d58e-433a-a7d3-7a81edffb3d3 (1e3b67dd-d58e-433a-a7d3-7a81edffb3d3): created successfully Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1410588d-b09a-4685-901c-50eb147c4ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Flow 'volume_create_manager' (120cfa4d-43b5-4dec-b700-a8ef4c67882e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:48 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-c603628c-9ca6-4e7b-ae50-bafd7dd85172 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Created volume successfully. Jul 21 02:24:48 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-343e07f5-0bfd-4ea1-8c2e-f768434927cf tempest-CreateVolumesFromImageTest-132087810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-16f707b0-52c1-4a85-8068-56917486ee76" returned: 0 in 0.404s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-343e07f5-0bfd-4ea1-8c2e-f768434927cf tempest-CreateVolumesFromImageTest-132087810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-16f707b0-52c1-4a85-8068-56917486ee76 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:48 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-16f707b0-52c1-4a85-8068-56917486ee76 Jul 21 02:24:48 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:48 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e7c64dc9-13ec-4ceb-af0b-78a8bf6551df 1073741824" returned: 0 in 0.480s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e7c64dc9-13ec-4ceb-af0b-78a8bf6551df {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:48 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e7c64dc9-13ec-4ceb-af0b-78a8bf6551df Jul 21 02:24:48 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:48 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-343e07f5-0bfd-4ea1-8c2e-f768434927cf tempest-CreateVolumesFromImageTest-132087810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-16f707b0-52c1-4a85-8068-56917486ee76" returned: 0 in 0.256s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-343e07f5-0bfd-4ea1-8c2e-f768434927cf tempest-CreateVolumesFromImageTest-132087810 None] Lock "cinder-quobyte-16f707b0-52c1-4a85-8068-56917486ee76" released by "delete_volume" :: held 0.707s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-343e07f5-0bfd-4ea1-8c2e-f768434927cf tempest-CreateVolumesFromImageTest-132087810 None] Created reservations ['e287f80c-f09d-4e99-9661-ecc17dfef831', '8d676ac7-ac29-46af-9b1b-989d0b6b4895', 'c4213947-f936-4010-8a0c-c5999c316290', '413c0d1f-aceb-4429-8087-06447639bcab'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-343e07f5-0bfd-4ea1-8c2e-f768434927cf tempest-CreateVolumesFromImageTest-132087810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-343e07f5-0bfd-4ea1-8c2e-f768434927cf tempest-CreateVolumesFromImageTest-132087810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-343e07f5-0bfd-4ea1-8c2e-f768434927cf tempest-CreateVolumesFromImageTest-132087810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-343e07f5-0bfd-4ea1-8c2e-f768434927cf tempest-CreateVolumesFromImageTest-132087810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-343e07f5-0bfd-4ea1-8c2e-f768434927cf tempest-CreateVolumesFromImageTest-132087810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-343e07f5-0bfd-4ea1-8c2e-f768434927cf tempest-CreateVolumesFromImageTest-132087810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:48 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:24:48 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:48 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e7c64dc9-13ec-4ceb-af0b-78a8bf6551df" returned: 0 in 0.253s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.820s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1597623616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4092281-3261-40f2-a4b7-9b08094da1e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f51ef2d52994a98b517685a68ffab5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:24:43Z,use_quota=True,user_id='44cda6aaa9784b3e97f478fab2914f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Creating volume b4092281-3261-40f2-a4b7-9b08094da1e6 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:24:48 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b4092281-3261-40f2-a4b7-9b08094da1e6 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596bd378-d101-47d3-9265-d62b37807fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7c64dc9-13ec-4ceb-af0b-78a8bf6551df', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:48 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b4092281-3261-40f2-a4b7-9b08094da1e6 1073741824 Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (821dd376-99e5-4f4d-8f90-31b449d5ac0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:48 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:48 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Volume volume-e7c64dc9-13ec-4ceb-af0b-78a8bf6551df (e7c64dc9-13ec-4ceb-af0b-78a8bf6551df): created successfully Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (821dd376-99e5-4f4d-8f90-31b449d5ac0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Flow 'volume_create_manager' (d25ef512-31df-4036-bde3-c7d4b4456826) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:48 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-9944d975-71bb-4f01-bba2-20058413f537 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Created volume successfully. Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:48 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:24:48 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:48 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-343e07f5-0bfd-4ea1-8c2e-f768434927cf tempest-CreateVolumesFromImageTest-132087810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.276s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-343e07f5-0bfd-4ea1-8c2e-f768434927cf tempest-CreateVolumesFromImageTest-132087810 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:24:48 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e556c104-d1cb-4f15-85fe-9b609f637247 tempest-CreateVolumesFromImageTest-132087810 None] Acquiring lock "cinder-aa28ab87-51dd-439f-8294-94b26cd099c6-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:48 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-343e07f5-0bfd-4ea1-8c2e-f768434927cf tempest-CreateVolumesFromImageTest-132087810 None] Deleted volume successfully. Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e556c104-d1cb-4f15-85fe-9b609f637247 tempest-CreateVolumesFromImageTest-132087810 None] Lock "cinder-aa28ab87-51dd-439f-8294-94b26cd099c6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-343e07f5-0bfd-4ea1-8c2e-f768434927cf tempest-CreateVolumesFromImageTest-132087810 None] Lock "cinder-16f707b0-52c1-4a85-8068-56917486ee76-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e556c104-d1cb-4f15-85fe-9b609f637247 tempest-CreateVolumesFromImageTest-132087810 None] Acquiring lock "cinder-quobyte-aa28ab87-51dd-439f-8294-94b26cd099c6" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e556c104-d1cb-4f15-85fe-9b609f637247 tempest-CreateVolumesFromImageTest-132087810 None] Lock "cinder-quobyte-aa28ab87-51dd-439f-8294-94b26cd099c6" acquired by "delete_volume" :: waited 0.023s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee4ab4b-7f22-45e2-bd06-dc09ac1191bf]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e556c104-d1cb-4f15-85fe-9b609f637247 tempest-CreateVolumesFromImageTest-132087810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-aa28ab87-51dd-439f-8294-94b26cd099c6 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:49 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.326s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager._thread_info {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread count: 28 {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 02:24:49 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-aa28ab87-51dd-439f-8294-94b26cd099c6 Jul 21 02:24:49 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread info: [<_MainThread(MainThread, started 135786703114368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 02:24:49 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b4092281-3261-40f2-a4b7-9b08094da1e6 1073741824" returned: 0 in 0.523s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b4092281-3261-40f2-a4b7-9b08094da1e6 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:49 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b4092281-3261-40f2-a4b7-9b08094da1e6 Jul 21 02:24:49 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:49 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e556c104-d1cb-4f15-85fe-9b609f637247 tempest-CreateVolumesFromImageTest-132087810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-aa28ab87-51dd-439f-8294-94b26cd099c6" returned: 0 in 0.375s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e556c104-d1cb-4f15-85fe-9b609f637247 tempest-CreateVolumesFromImageTest-132087810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-aa28ab87-51dd-439f-8294-94b26cd099c6 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:49 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-aa28ab87-51dd-439f-8294-94b26cd099c6 Jul 21 02:24:49 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:49 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b4092281-3261-40f2-a4b7-9b08094da1e6" returned: 0 in 0.264s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.125s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab46328251eb48f6935504aa507f1568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:24:41Z,use_quota=True,user_id='b832c7864ffc47ccb1eaa57741da09e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a83e00eb-6d0c-4a1e-9854-f2e362048de9),volume_type_id=a83e00eb-6d0c-4a1e-9854-f2e362048de9)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Creating volume 4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:24:49 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:49 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3 1073741824 Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a11d3b3-6f87-4dac-ba69-0529038c15b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4092281-3261-40f2-a4b7-9b08094da1e6', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:49 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (474bb8ce-94f4-4166-b7d1-8dca29c76932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:49 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Volume volume-b4092281-3261-40f2-a4b7-9b08094da1e6 (b4092281-3261-40f2-a4b7-9b08094da1e6): created successfully Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (474bb8ce-94f4-4166-b7d1-8dca29c76932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Flow 'volume_create_manager' (19c4a00a-5840-4507-8a3c-bdcafd97d377) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:49 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-9aca6f46-8ea3-4e1a-b3c9-1698cdca7681 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Created volume successfully. Jul 21 02:24:49 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e556c104-d1cb-4f15-85fe-9b609f637247 tempest-CreateVolumesFromImageTest-132087810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-aa28ab87-51dd-439f-8294-94b26cd099c6" returned: 0 in 0.269s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e556c104-d1cb-4f15-85fe-9b609f637247 tempest-CreateVolumesFromImageTest-132087810 None] Lock "cinder-quobyte-aa28ab87-51dd-439f-8294-94b26cd099c6" released by "delete_volume" :: held 0.686s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-e556c104-d1cb-4f15-85fe-9b609f637247 tempest-CreateVolumesFromImageTest-132087810 None] Created reservations ['b0cfeb7a-8dcb-4a8d-be81-4a2b8643c83c', 'b47d4de7-8033-48cc-a6d4-40e9b85f4e4d', 'f13f80df-dbc1-43f5-b60c-0702d67a0b8d', '5c64704c-ef46-4e01-a4db-d8e29dd3ca9e'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e556c104-d1cb-4f15-85fe-9b609f637247 tempest-CreateVolumesFromImageTest-132087810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e556c104-d1cb-4f15-85fe-9b609f637247 tempest-CreateVolumesFromImageTest-132087810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e556c104-d1cb-4f15-85fe-9b609f637247 tempest-CreateVolumesFromImageTest-132087810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e556c104-d1cb-4f15-85fe-9b609f637247 tempest-CreateVolumesFromImageTest-132087810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e556c104-d1cb-4f15-85fe-9b609f637247 tempest-CreateVolumesFromImageTest-132087810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e556c104-d1cb-4f15-85fe-9b609f637247 tempest-CreateVolumesFromImageTest-132087810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:49 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:24:49 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:50 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3 1073741824" returned: 0 in 0.418s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:50 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3 Jul 21 02:24:50 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:50 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e556c104-d1cb-4f15-85fe-9b609f637247 tempest-CreateVolumesFromImageTest-132087810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.266s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-e556c104-d1cb-4f15-85fe-9b609f637247 tempest-CreateVolumesFromImageTest-132087810 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:24:50 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-e556c104-d1cb-4f15-85fe-9b609f637247 tempest-CreateVolumesFromImageTest-132087810 None] Deleted volume successfully. Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e556c104-d1cb-4f15-85fe-9b609f637247 tempest-CreateVolumesFromImageTest-132087810 None] Lock "cinder-aa28ab87-51dd-439f-8294-94b26cd099c6-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:24:50 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3" returned: 0 in 0.280s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.108s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Acquiring lock "cinder-quobyte-6b427ac9-2dd8-438c-8696-7a3226e1c58c-eaa893c0-70b9-4062-9373-10feac406699" by "_create_volume_from_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Lock "cinder-quobyte-6b427ac9-2dd8-438c-8696-7a3226e1c58c-eaa893c0-70b9-4062-9373-10feac406699" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Creating volume eaa893c0-70b9-4062-9373-10feac406699 from snapshot 6b427ac9-2dd8-438c-8696-7a3226e1c58c {{(pid=87566) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Acquiring lock "cinder-quobyte-eaa893c0-70b9-4062-9373-10feac406699" by "_copy_volume_from_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG cinder.volume.volume_utils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Attempting download of 3d1844dc-8ba1-47df-9556-8b164518df34 ((None, [{'url': 'file:///opt/stack/data/glance/images/3d1844dc-8ba1-47df-9556-8b164518df34', 'metadata': {}}])) to volume 4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3. {{(pid=87566) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Lock "cinder-quobyte-eaa893c0-70b9-4062-9373-10feac406699" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] snapshot: 6b427ac9-2dd8-438c-8696-7a3226e1c58c, volume: eaa893c0-70b9-4062-9373-10feac406699, {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a12670-6fcd-48a1-8c04-e904e1e5a635]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[8460427f-fad9-4cda-aca8-b68752d6b78d]: (4, 'raw') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb.6b427ac9-2dd8-438c-8696-7a3226e1c58c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d1844dc-8ba1-47df-9556-8b164518df34_qy85u1bl {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9cb5e8b9-a490-4504-8460-d32d85d837eb tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Acquiring lock "cinder-b4092281-3261-40f2-a4b7-9b08094da1e6-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9cb5e8b9-a490-4504-8460-d32d85d837eb tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "cinder-b4092281-3261-40f2-a4b7-9b08094da1e6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:50 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d1844dc-8ba1-47df-9556-8b164518df34_qy85u1bl Jul 21 02:24:50 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:50 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb.6b427ac9-2dd8-438c-8696-7a3226e1c58c Jul 21 02:24:50 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9cb5e8b9-a490-4504-8460-d32d85d837eb tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Acquiring lock "cinder-quobyte-b4092281-3261-40f2-a4b7-9b08094da1e6" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9cb5e8b9-a490-4504-8460-d32d85d837eb tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "cinder-quobyte-b4092281-3261-40f2-a4b7-9b08094da1e6" acquired by "delete_volume" :: waited 0.037s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a79dcb-1e44-45f7-a9e8-c65d2799bc46]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9cb5e8b9-a490-4504-8460-d32d85d837eb tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b4092281-3261-40f2-a4b7-9b08094da1e6 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:50 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b4092281-3261-40f2-a4b7-9b08094da1e6 Jul 21 02:24:50 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:50 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d1844dc-8ba1-47df-9556-8b164518df34_qy85u1bl" returned: 0 in 0.397s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d1844dc-8ba1-47df-9556-8b164518df34_qy85u1bl {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:50 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb.6b427ac9-2dd8-438c-8696-7a3226e1c58c" returned: 0 in 0.482s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-412c9fe6-be9c-49da-8620-08181cb16efb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Creating direct copy from snapshot {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ed2a8f-7b43-48e6-96b4-4ec593202577]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:24:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:51 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d1844dc-8ba1-47df-9556-8b164518df34_qy85u1bl Jul 21 02:24:51 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:51 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb Jul 21 02:24:51 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:51 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9cb5e8b9-a490-4504-8460-d32d85d837eb tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b4092281-3261-40f2-a4b7-9b08094da1e6" returned: 0 in 0.517s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9cb5e8b9-a490-4504-8460-d32d85d837eb tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b4092281-3261-40f2-a4b7-9b08094da1e6 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:51 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b4092281-3261-40f2-a4b7-9b08094da1e6 Jul 21 02:24:51 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:51 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d1844dc-8ba1-47df-9556-8b164518df34_qy85u1bl" returned: 1 in 0.513s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:51 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d1844dc-8ba1-47df-9556-8b164518df34_qy85u1bl' failed. Not Retrying. {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 02:24:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb" returned: 0 in 0.427s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:51 devstack cinder-volume[87566]: DEBUG cinder.utils [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Path /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-eaa893c0-70b9-4062-9373-10feac406699 not found in is_blk_device check {{(pid=87566) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 02:24:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-eaa893c0-70b9-4062-9373-10feac406699 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:51 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[318ac5fa-e3bc-4c89-9d4e-7b08331c27d2]: (4, 'raw') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:24:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d1844dc-8ba1-47df-9556-8b164518df34_5cuyo8mydevstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:51 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-eaa893c0-70b9-4062-9373-10feac406699 Jul 21 02:24:51 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:51 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d1844dc-8ba1-47df-9556-8b164518df34_5cuyo8mydevstack@QuobyteHD Jul 21 02:24:51 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:51 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9cb5e8b9-a490-4504-8460-d32d85d837eb tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b4092281-3261-40f2-a4b7-9b08094da1e6" returned: 0 in 0.309s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:51 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9cb5e8b9-a490-4504-8460-d32d85d837eb tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "cinder-quobyte-b4092281-3261-40f2-a4b7-9b08094da1e6" released by "delete_volume" :: held 0.879s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:24:51 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-9cb5e8b9-a490-4504-8460-d32d85d837eb tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Created reservations ['6d6dec4d-f090-4eb7-8540-4f92a41ec811', '5b9d210d-c29f-4b47-a940-21fdd14f0ce8', '0fea1123-9960-4caa-8214-31e03d44cbfb', 'e298005c-3e70-4d15-93bd-daa2cc40f253'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:24:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9cb5e8b9-a490-4504-8460-d32d85d837eb tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9cb5e8b9-a490-4504-8460-d32d85d837eb tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:51 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9cb5e8b9-a490-4504-8460-d32d85d837eb tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:24:51 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9cb5e8b9-a490-4504-8460-d32d85d837eb tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:24:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9cb5e8b9-a490-4504-8460-d32d85d837eb tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9cb5e8b9-a490-4504-8460-d32d85d837eb tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:51 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:24:51 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:51 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d1844dc-8ba1-47df-9556-8b164518df34_5cuyo8mydevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d1844dc-8ba1-47df-9556-8b164518df34_5cuyo8mydevstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:51 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f870528b-8a8f-4e80-bce6-704639b2b122 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Acquiring lock "cinder-e7c64dc9-13ec-4ceb-af0b-78a8bf6551df-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:51 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f870528b-8a8f-4e80-bce6-704639b2b122 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "cinder-e7c64dc9-13ec-4ceb-af0b-78a8bf6551df-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:51 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f870528b-8a8f-4e80-bce6-704639b2b122 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Acquiring lock "cinder-quobyte-e7c64dc9-13ec-4ceb-af0b-78a8bf6551df" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:51 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f870528b-8a8f-4e80-bce6-704639b2b122 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "cinder-quobyte-e7c64dc9-13ec-4ceb-af0b-78a8bf6551df" acquired by "delete_volume" :: waited 0.020s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:52 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[20713e8a-16eb-4205-b819-207577628dfe]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:24:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f870528b-8a8f-4e80-bce6-704639b2b122 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e7c64dc9-13ec-4ceb-af0b-78a8bf6551df {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:52 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d1844dc-8ba1-47df-9556-8b164518df34_5cuyo8mydevstack@QuobyteHD Jul 21 02:24:52 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:52 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e7c64dc9-13ec-4ceb-af0b-78a8bf6551df Jul 21 02:24:52 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:52 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9cb5e8b9-a490-4504-8460-d32d85d837eb tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.531s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:52 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-9cb5e8b9-a490-4504-8460-d32d85d837eb tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:24:52 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-9cb5e8b9-a490-4504-8460-d32d85d837eb tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Deleted volume successfully. Jul 21 02:24:52 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9cb5e8b9-a490-4504-8460-d32d85d837eb tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "cinder-b4092281-3261-40f2-a4b7-9b08094da1e6-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:24:52 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d1844dc-8ba1-47df-9556-8b164518df34_5cuyo8mydevstack@QuobyteHD" returned: 1 in 0.868s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d1844dc-8ba1-47df-9556-8b164518df34_5cuyo8mydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 02:24:52 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] 3d1844dc-8ba1-47df-9556-8b164518df34 was raw, converting to qcow2 {{(pid=87566) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 02:24:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3d1844dc-8ba1-47df-9556-8b164518df34_5cuyo8mydevstack@QuobyteHD /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:52 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3d1844dc-8ba1-47df-9556-8b164518df34_5cuyo8mydevstack@QuobyteHD /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3 Jul 21 02:24:52 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:52 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f870528b-8a8f-4e80-bce6-704639b2b122 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e7c64dc9-13ec-4ceb-af0b-78a8bf6551df" returned: 0 in 0.810s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f870528b-8a8f-4e80-bce6-704639b2b122 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e7c64dc9-13ec-4ceb-af0b-78a8bf6551df {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:52 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e7c64dc9-13ec-4ceb-af0b-78a8bf6551df Jul 21 02:24:52 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:53 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f870528b-8a8f-4e80-bce6-704639b2b122 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e7c64dc9-13ec-4ceb-af0b-78a8bf6551df" returned: 0 in 0.622s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:53 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f870528b-8a8f-4e80-bce6-704639b2b122 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "cinder-quobyte-e7c64dc9-13ec-4ceb-af0b-78a8bf6551df" released by "delete_volume" :: held 1.504s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:24:53 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-f870528b-8a8f-4e80-bce6-704639b2b122 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Created reservations ['5a70ecc2-a333-44b6-89a9-ca1057839e72', '25b60208-ac85-44ca-997a-02d960cc7f93', '9b12ce9c-d18d-4c60-b729-7c3923c3fda8', '6518b34b-bfb7-44c7-99bf-8f3a85e1f566'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:24:53 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f870528b-8a8f-4e80-bce6-704639b2b122 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f870528b-8a8f-4e80-bce6-704639b2b122 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f870528b-8a8f-4e80-bce6-704639b2b122 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:24:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-f870528b-8a8f-4e80-bce6-704639b2b122 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:24:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f870528b-8a8f-4e80-bce6-704639b2b122 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f870528b-8a8f-4e80-bce6-704639b2b122 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3d1844dc-8ba1-47df-9556-8b164518df34_5cuyo8mydevstack@QuobyteHD /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3" returned: 0 in 1.192s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:53 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3d1844dc-8ba1-47df-9556-8b164518df34_5cuyo8mydevstack@QuobyteHD, size 0.00 MB, duration 1.20 sec, destination /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3 {{(pid=87566) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 02:24:53 devstack cinder-volume[87566]: INFO cinder.image.image_utils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Converted 0.00 MB image at 0.00 MB/s Jul 21 02:24:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:53 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:24:53 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:54 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3 1G Jul 21 02:24:54 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:54 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f870528b-8a8f-4e80-bce6-704639b2b122 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.617s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:54 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-f870528b-8a8f-4e80-bce6-704639b2b122 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:24:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4e248810-0002-4cd0-9f6d-b3c73a2ac777 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Acquiring lock "cinder-1e3b67dd-d58e-433a-a7d3-7a81edffb3d3-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:54 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-f870528b-8a8f-4e80-bce6-704639b2b122 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Deleted volume successfully. Jul 21 02:24:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4e248810-0002-4cd0-9f6d-b3c73a2ac777 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "cinder-1e3b67dd-d58e-433a-a7d3-7a81edffb3d3-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f870528b-8a8f-4e80-bce6-704639b2b122 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "cinder-e7c64dc9-13ec-4ceb-af0b-78a8bf6551df-delete_volume" released by "delete_volume" :: held 2.729s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:24:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4e248810-0002-4cd0-9f6d-b3c73a2ac777 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Acquiring lock "cinder-quobyte-1e3b67dd-d58e-433a-a7d3-7a81edffb3d3" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4e248810-0002-4cd0-9f6d-b3c73a2ac777 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "cinder-quobyte-1e3b67dd-d58e-433a-a7d3-7a81edffb3d3" acquired by "delete_volume" :: waited 0.056s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:54 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3 1G" returned: 0 in 0.893s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:54 devstack cinder-volume[87566]: DEBUG cinder.volume.volume_utils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Downloaded image 3d1844dc-8ba1-47df-9556-8b164518df34 ((None, [{'url': 'file:///opt/stack/data/glance/images/3d1844dc-8ba1-47df-9556-8b164518df34', 'metadata': {}}])) to volume 4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3 successfully. {{(pid=87566) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 02:24:54 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Temporary image 3d1844dc-8ba1-47df-9556-8b164518df34 for user b832c7864ffc47ccb1eaa57741da09e4 is deleted. {{(pid=87566) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 02:24:54 devstack cinder-volume[87566]: DEBUG cinder.volume.volume_utils [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Marking volume 4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3 as bootable. {{(pid=87566) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 02:24:54 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8e574d-5e8f-45c8-9ce6-1e96a8315b72]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:24:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4e248810-0002-4cd0-9f6d-b3c73a2ac777 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1e3b67dd-d58e-433a-a7d3-7a81edffb3d3 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:54 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Copying metadata from image 3d1844dc-8ba1-47df-9556-8b164518df34 to 4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3. {{(pid=87566) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 02:24:54 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Creating volume glance metadata for volume 4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3 backed by image 3d1844dc-8ba1-47df-9556-8b164518df34 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '3d1844dc-8ba1-47df-9556-8b164518df34', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '2fa4743c740ca372851ecae6e2037a1e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87566) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 02:24:55 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1e3b67dd-d58e-433a-a7d3-7a81edffb3d3 Jul 21 02:24:55 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcaa23ad-4b92-44d3-800e-36d3002edb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3', 'volume_size': 1, 'image_id': '3d1844dc-8ba1-47df-9556-8b164518df34', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d1844dc-8ba1-47df-9556-8b164518df34', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2fa4743c740ca372851ecae6e2037a1e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ab46328251eb48f6935504aa507f1568', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '046737eb35e8c677127f2b75a750feb4676f184be5cdba35da750c457231e476ba795605d0fb856edd56849fa424e7257d9d38d9a42b7293679e74ab1baa256f', 'id': '3d1844dc-8ba1-47df-9556-8b164518df34', 'created_at': datetime.datetime(2026, 7, 21, 0, 24, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 0, 24, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d1844dc-8ba1-47df-9556-8b164518df34/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7224ecf3-a7c7-47f3-8f51-7cc0e0c189d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:55 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Volume volume-4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3 (4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3): created successfully Jul 21 02:24:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7224ecf3-a7c7-47f3-8f51-7cc0e0c189d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Flow 'volume_create_manager' (a68d7426-cfa7-461c-a017-21fccfc30c57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:55 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-69923465-244b-4055-9fb7-357010c97b4d tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Created volume successfully. Jul 21 02:24:55 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4e248810-0002-4cd0-9f6d-b3c73a2ac777 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1e3b67dd-d58e-433a-a7d3-7a81edffb3d3" returned: 0 in 0.767s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4e248810-0002-4cd0-9f6d-b3c73a2ac777 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1e3b67dd-d58e-433a-a7d3-7a81edffb3d3 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:55 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1e3b67dd-d58e-433a-a7d3-7a81edffb3d3 Jul 21 02:24:55 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:56 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4e248810-0002-4cd0-9f6d-b3c73a2ac777 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1e3b67dd-d58e-433a-a7d3-7a81edffb3d3" returned: 0 in 0.573s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:56 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4e248810-0002-4cd0-9f6d-b3c73a2ac777 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "cinder-quobyte-1e3b67dd-d58e-433a-a7d3-7a81edffb3d3" released by "delete_volume" :: held 1.459s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:24:56 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-4e248810-0002-4cd0-9f6d-b3c73a2ac777 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Created reservations ['c94e04f6-4ebb-4adb-bd5a-7f934bd44fb9', '57767f44-435c-484d-b35b-c0fe6eb6841b', '2e2e6c98-cf0a-46de-8698-344b9e683e57', 'c1e5628f-e007-42b7-b415-0f7f5523fc72'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:24:56 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b2d0d021-5737-4ff5-b9ec-3e0bfd48c2f4 tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Acquiring lock "cinder-4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:56 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b2d0d021-5737-4ff5-b9ec-3e0bfd48c2f4 tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Lock "cinder-4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:56 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:24:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Flow 'volume_create_manager' (32be2025-558a-40cc-b3bb-6fa3256f1ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f49b95-465d-484b-8242-f9ca2f8e5e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f49b95-465d-484b-8242-f9ca2f8e5e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-170095313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff872f22-8d12-4d9f-aed6-f1810e434c6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2e738c4a3c49718d666de7e06fe282',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:24:56Z,use_quota=True,user_id='08723b60f0dc4615b1a183502e6558f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4839755e-7060-4fc1-a9b4-b19d83e76b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4839755e-7060-4fc1-a9b4-b19d83e76b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c1e92e-ecd8-4d09-9f6a-f244675b0e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c1e92e-ecd8-4d09-9f6a-f244675b0e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff872f22-8d12-4d9f-aed6-f1810e434c6f', 'volume_name': 'volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c41c4c26-02a5-4a28-90fe-3839e5f7bc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c41c4c26-02a5-4a28-90fe-3839e5f7bc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d456075-400f-4cd9-afae-a4989d71c3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:56 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Volume ff872f22-8d12-4d9f-aed6-f1810e434c6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f', 'volume_size': 1} Jul 21 02:24:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:56 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b2d0d021-5737-4ff5-b9ec-3e0bfd48c2f4 tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Acquiring lock "cinder-quobyte-4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:57 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b2d0d021-5737-4ff5-b9ec-3e0bfd48c2f4 tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Lock "cinder-quobyte-4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3" acquired by "delete_volume" :: waited 0.086s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4e248810-0002-4cd0-9f6d-b3c73a2ac777 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4e248810-0002-4cd0-9f6d-b3c73a2ac777 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:57 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4e248810-0002-4cd0-9f6d-b3c73a2ac777 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:24:57 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4e248810-0002-4cd0-9f6d-b3c73a2ac777 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:24:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4e248810-0002-4cd0-9f6d-b3c73a2ac777 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4e248810-0002-4cd0-9f6d-b3c73a2ac777 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:57 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[21efe52f-ae12-49e6-b306-178ad567600e]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:24:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b2d0d021-5737-4ff5-b9ec-3e0bfd48c2f4 tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:57 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:24:57 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:57 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-022b1d63-99d9-4596-8b66-939b54979f8c tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Acquiring lock "cinder-d56d0aba-6644-4607-9ac2-bf5ed1269128-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:57 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-022b1d63-99d9-4596-8b66-939b54979f8c tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "cinder-d56d0aba-6644-4607-9ac2-bf5ed1269128-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:57 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-022b1d63-99d9-4596-8b66-939b54979f8c tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Acquiring lock "cinder-quobyte-d56d0aba-6644-4607-9ac2-bf5ed1269128" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:57 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-eaa893c0-70b9-4062-9373-10feac406699" returned: 0 in 6.016s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:57 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3 Jul 21 02:24:57 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:57 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-022b1d63-99d9-4596-8b66-939b54979f8c tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "cinder-quobyte-d56d0aba-6644-4607-9ac2-bf5ed1269128" acquired by "delete_volume" :: waited 0.043s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:57 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[d238e683-e1b6-470f-8f3c-c458af965b13]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:24:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:57 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1a8184-4eea-45fb-adef-f7830cb883a7]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:24:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-022b1d63-99d9-4596-8b66-939b54979f8c tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d56d0aba-6644-4607-9ac2-bf5ed1269128 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:57 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb Jul 21 02:24:57 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:57 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4e248810-0002-4cd0-9f6d-b3c73a2ac777 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.548s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:57 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-4e248810-0002-4cd0-9f6d-b3c73a2ac777 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:24:57 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-4e248810-0002-4cd0-9f6d-b3c73a2ac777 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Deleted volume successfully. Jul 21 02:24:57 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d56d0aba-6644-4607-9ac2-bf5ed1269128 Jul 21 02:24:57 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:57 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4e248810-0002-4cd0-9f6d-b3c73a2ac777 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "cinder-1e3b67dd-d58e-433a-a7d3-7a81edffb3d3-delete_volume" released by "delete_volume" :: held 3.139s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:24:57 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b2d0d021-5737-4ff5-b9ec-3e0bfd48c2f4 tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3" returned: 0 in 0.648s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b2d0d021-5737-4ff5-b9ec-3e0bfd48c2f4 tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:57 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3 Jul 21 02:24:57 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:58 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-022b1d63-99d9-4596-8b66-939b54979f8c tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d56d0aba-6644-4607-9ac2-bf5ed1269128" returned: 0 in 0.504s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-022b1d63-99d9-4596-8b66-939b54979f8c tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d56d0aba-6644-4607-9ac2-bf5ed1269128 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:58 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d56d0aba-6644-4607-9ac2-bf5ed1269128 Jul 21 02:24:58 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:58 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b2d0d021-5737-4ff5-b9ec-3e0bfd48c2f4 tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3" returned: 0 in 0.260s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b2d0d021-5737-4ff5-b9ec-3e0bfd48c2f4 tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Lock "cinder-quobyte-4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3" released by "delete_volume" :: held 1.041s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:24:58 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb" returned: 0 in 0.662s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Image conversion details: src /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb, size 1024.00 MB, duration 6.02 sec, destination /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-eaa893c0-70b9-4062-9373-10feac406699 {{(pid=87566) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 02:24:58 devstack cinder-volume[87566]: INFO cinder.image.image_utils [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Converted 1024.00 MB image at 170.18 MB/s Jul 21 02:24:58 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-eaa893c0-70b9-4062-9373-10feac406699 is being set with open permissions: ugo+rw Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-eaa893c0-70b9-4062-9373-10feac406699 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-b2d0d021-5737-4ff5-b9ec-3e0bfd48c2f4 tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Created reservations ['22179f2f-9061-4696-b1d0-1c795535f995', 'd440d234-2bd2-4d5b-bcb8-22e6aa950947', '2935cad9-3fc3-466a-a26f-ddff9222bd41', 'c26ac2b9-e280-4fbf-946f-feb4bb4e2b88'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:24:58 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-eaa893c0-70b9-4062-9373-10feac406699 Jul 21 02:24:58 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b2d0d021-5737-4ff5-b9ec-3e0bfd48c2f4 tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b2d0d021-5737-4ff5-b9ec-3e0bfd48c2f4 tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b2d0d021-5737-4ff5-b9ec-3e0bfd48c2f4 tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b2d0d021-5737-4ff5-b9ec-3e0bfd48c2f4 tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b2d0d021-5737-4ff5-b9ec-3e0bfd48c2f4 tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b2d0d021-5737-4ff5-b9ec-3e0bfd48c2f4 tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:58 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:24:58 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:58 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-022b1d63-99d9-4596-8b66-939b54979f8c tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-d56d0aba-6644-4607-9ac2-bf5ed1269128" returned: 0 in 0.268s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-022b1d63-99d9-4596-8b66-939b54979f8c tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "cinder-quobyte-d56d0aba-6644-4607-9ac2-bf5ed1269128" released by "delete_volume" :: held 0.854s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-022b1d63-99d9-4596-8b66-939b54979f8c tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Created reservations ['7af3d999-57db-4ef2-8587-78742ba31835', 'f8bc4f73-e394-4b74-8ee9-e04a6466b41a', '2e9fca0c-02cb-4043-8efd-1e608c32e143', 'f50ff298-15a5-4d82-844c-9c75136d7038'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:24:58 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-eaa893c0-70b9-4062-9373-10feac406699" returned: 0 in 0.274s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Lock "cinder-quobyte-eaa893c0-70b9-4062-9373-10feac406699" released by "_copy_volume_from_snapshot" :: held 8.015s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Lock "cinder-quobyte-6b427ac9-2dd8-438c-8696-7a3226e1c58c-eaa893c0-70b9-4062-9373-10feac406699" released by "_create_volume_from_snapshot" :: held 8.065s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.088s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.616s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-170095313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff872f22-8d12-4d9f-aed6-f1810e434c6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2e738c4a3c49718d666de7e06fe282',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:24:56Z,use_quota=True,user_id='08723b60f0dc4615b1a183502e6558f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Creating volume ff872f22-8d12-4d9f-aed6-f1810e434c6f {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:24:58 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:58 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f 1073741824 Jul 21 02:24:58 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-022b1d63-99d9-4596-8b66-939b54979f8c tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-022b1d63-99d9-4596-8b66-939b54979f8c tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-022b1d63-99d9-4596-8b66-939b54979f8c tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-022b1d63-99d9-4596-8b66-939b54979f8c tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-022b1d63-99d9-4596-8b66-939b54979f8c tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-022b1d63-99d9-4596-8b66-939b54979f8c tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:58 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b2d0d021-5737-4ff5-b9ec-3e0bfd48c2f4 tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.291s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-b2d0d021-5737-4ff5-b9ec-3e0bfd48c2f4 tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:24:58 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:24:58 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14e4afbc-7d7f-425c-9f5b-4ff1619b2224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaa893c0-70b9-4062-9373-10feac406699', 'volume_size': 1, 'snapshot_id': '6b427ac9-2dd8-438c-8696-7a3226e1c58c'}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5457c873-bf3f-4e39-b11b-220486b84014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:58 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-b2d0d021-5737-4ff5-b9ec-3e0bfd48c2f4 tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Deleted volume successfully. Jul 21 02:24:58 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Volume volume-eaa893c0-70b9-4062-9373-10feac406699 (eaa893c0-70b9-4062-9373-10feac406699): created successfully Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5457c873-bf3f-4e39-b11b-220486b84014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Flow 'volume_create_manager' (a401f7b6-f5fb-4c58-930e-2471d54da8e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b2d0d021-5737-4ff5-b9ec-3e0bfd48c2f4 tempest-VolumeAndVolumeTypeFromImageTest-1293439037 None] Lock "cinder-4119a92b-35fa-4ffa-aa84-1ce5d0de6ec3-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:24:58 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-412ba851-c285-4e0a-b323-ac0a0488f33c tempest-VolumeDependencyTests-113875028 None] Created volume successfully. Jul 21 02:24:58 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-022b1d63-99d9-4596-8b66-939b54979f8c tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.254s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-022b1d63-99d9-4596-8b66-939b54979f8c tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:24:58 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-022b1d63-99d9-4596-8b66-939b54979f8c tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Deleted volume successfully. Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-022b1d63-99d9-4596-8b66-939b54979f8c tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "cinder-d56d0aba-6644-4607-9ac2-bf5ed1269128-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:24:58 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f 1073741824" returned: 0 in 0.518s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:59 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f Jul 21 02:24:59 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:59 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Jul 21 02:24:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f" returned: 0 in 0.258s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:24:59 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:24:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:24:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d456075-400f-4cd9-afae-a4989d71c3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7d7c3e-6f28-4529-95a3-fd3202ec4812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:24:59 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Volume volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f (ff872f22-8d12-4d9f-aed6-f1810e434c6f): created successfully Jul 21 02:24:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7d7c3e-6f28-4529-95a3-fd3202ec4812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:24:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Flow 'volume_create_manager' (32be2025-558a-40cc-b3bb-6fa3256f1ccc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:24:59 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-01323d42-d1e4-43a6-9a57-0a5aed01c4c9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Created volume successfully. Jul 21 02:24:59 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ce3f19f8-16f0-4ac3-9a63-7550cd08119d tempest-VolumeDependencyTests-113875028 None] Acquiring lock "cinder-6b427ac9-2dd8-438c-8696-7a3226e1c58c-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:59 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-95871a80-157d-4b88-801f-5ef33be64774 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Acquiring lock "cinder-c13f072c-da78-4a8a-918c-3602b3f082a0-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:59 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ce3f19f8-16f0-4ac3-9a63-7550cd08119d tempest-VolumeDependencyTests-113875028 None] Lock "cinder-6b427ac9-2dd8-438c-8696-7a3226e1c58c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:59 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ce3f19f8-16f0-4ac3-9a63-7550cd08119d tempest-VolumeDependencyTests-113875028 None] Acquiring lock "cinder-quobyte-412c9fe6-be9c-49da-8620-08181cb16efb" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:59 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-95871a80-157d-4b88-801f-5ef33be64774 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "cinder-c13f072c-da78-4a8a-918c-3602b3f082a0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:59 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ce3f19f8-16f0-4ac3-9a63-7550cd08119d tempest-VolumeDependencyTests-113875028 None] Lock "cinder-quobyte-412c9fe6-be9c-49da-8620-08181cb16efb" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:59 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ce3f19f8-16f0-4ac3-9a63-7550cd08119d tempest-VolumeDependencyTests-113875028 None] Acquiring lock "cinder-quobyte-6b427ac9-2dd8-438c-8696-7a3226e1c58c" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:59 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ce3f19f8-16f0-4ac3-9a63-7550cd08119d tempest-VolumeDependencyTests-113875028 None] Lock "cinder-quobyte-6b427ac9-2dd8-438c-8696-7a3226e1c58c" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:59 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-ce3f19f8-16f0-4ac3-9a63-7550cd08119d tempest-VolumeDependencyTests-113875028 None] Deleting offline snapshot 6b427ac9-2dd8-438c-8696-7a3226e1c58c of volume 412c9fe6-be9c-49da-8620-08181cb16efb {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:24:59 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-ce3f19f8-16f0-4ac3-9a63-7550cd08119d tempest-VolumeDependencyTests-113875028 None] snapshot_file for this snap is: volume-412c9fe6-be9c-49da-8620-08181cb16efb.6b427ac9-2dd8-438c-8696-7a3226e1c58c {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:24:59 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-95871a80-157d-4b88-801f-5ef33be64774 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Acquiring lock "cinder-quobyte-c13f072c-da78-4a8a-918c-3602b3f082a0" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:24:59 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ed2869-b3f2-4dad-b797-bfb3be9e24c9]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:24:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ce3f19f8-16f0-4ac3-9a63-7550cd08119d tempest-VolumeDependencyTests-113875028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb.6b427ac9-2dd8-438c-8696-7a3226e1c58c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:59 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-95871a80-157d-4b88-801f-5ef33be64774 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "cinder-quobyte-c13f072c-da78-4a8a-918c-3602b3f082a0" acquired by "delete_volume" :: waited 0.037s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:24:59 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ead01b3-4547-4ea5-aec6-b0b92acd37f8]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:24:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-95871a80-157d-4b88-801f-5ef33be64774 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c13f072c-da78-4a8a-918c-3602b3f082a0 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:24:59 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb.6b427ac9-2dd8-438c-8696-7a3226e1c58c Jul 21 02:24:59 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:59 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c13f072c-da78-4a8a-918c-3602b3f082a0 Jul 21 02:24:59 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:24:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-972d2878-e5f3-47d1-8327-3282ce8dff8f tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:24:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-972d2878-e5f3-47d1-8327-3282ce8dff8f tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:24:59 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-972d2878-e5f3-47d1-8327-3282ce8dff8f tempest-CreateVolumesFromSnapshotTest-797281576 None] Creating offline snapshot 89f4b894-07bc-43ef-8449-91a06c16cf9f of volume ff872f22-8d12-4d9f-aed6-f1810e434c6f {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:24:59 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[6350359e-8820-43f0-bb4e-1ee275127124]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:24:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-972d2878-e5f3-47d1-8327-3282ce8dff8f tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:00 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ce3f19f8-16f0-4ac3-9a63-7550cd08119d tempest-VolumeDependencyTests-113875028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb.6b427ac9-2dd8-438c-8696-7a3226e1c58c" returned: 0 in 0.455s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:00 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-ce3f19f8-16f0-4ac3-9a63-7550cd08119d tempest-VolumeDependencyTests-113875028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-412c9fe6-be9c-49da-8620-08181cb16efb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:25:00 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f Jul 21 02:25:00 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:00 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[7253a487-6550-42ff-bbac-4390a2c94760]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ce3f19f8-16f0-4ac3-9a63-7550cd08119d tempest-VolumeDependencyTests-113875028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:00 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-95871a80-157d-4b88-801f-5ef33be64774 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c13f072c-da78-4a8a-918c-3602b3f082a0" returned: 0 in 0.474s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-95871a80-157d-4b88-801f-5ef33be64774 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c13f072c-da78-4a8a-918c-3602b3f082a0 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:00 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c13f072c-da78-4a8a-918c-3602b3f082a0 Jul 21 02:25:00 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:00 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb Jul 21 02:25:00 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:00 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-972d2878-e5f3-47d1-8327-3282ce8dff8f tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f" returned: 0 in 0.526s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-972d2878-e5f3-47d1-8327-3282ce8dff8f tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f.89f4b894-07bc-43ef-8449-91a06c16cf9f 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:00 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-95871a80-157d-4b88-801f-5ef33be64774 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-c13f072c-da78-4a8a-918c-3602b3f082a0" returned: 0 in 0.328s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:00 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f.89f4b894-07bc-43ef-8449-91a06c16cf9f 1G Jul 21 02:25:00 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-95871a80-157d-4b88-801f-5ef33be64774 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "cinder-quobyte-c13f072c-da78-4a8a-918c-3602b3f082a0" released by "delete_volume" :: held 0.863s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:00 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:00 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-95871a80-157d-4b88-801f-5ef33be64774 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Created reservations ['ab112365-64b3-4604-8bf2-b5dee5912201', 'f65af39f-bc0f-416a-bbcc-8625a20378d5', '769a629d-288e-422a-8caa-a0846ab4ac6a', '15481745-b31e-490e-addc-04c50da53d10'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:00 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ce3f19f8-16f0-4ac3-9a63-7550cd08119d tempest-VolumeDependencyTests-113875028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb" returned: 0 in 0.540s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ce3f19f8-16f0-4ac3-9a63-7550cd08119d tempest-VolumeDependencyTests-113875028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb.6b427ac9-2dd8-438c-8696-7a3226e1c58c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:00 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb.6b427ac9-2dd8-438c-8696-7a3226e1c58c Jul 21 02:25:00 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-95871a80-157d-4b88-801f-5ef33be64774 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-95871a80-157d-4b88-801f-5ef33be64774 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:00 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-95871a80-157d-4b88-801f-5ef33be64774 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:00 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-95871a80-157d-4b88-801f-5ef33be64774 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-95871a80-157d-4b88-801f-5ef33be64774 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-95871a80-157d-4b88-801f-5ef33be64774 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:00 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:25:00 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:01 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-972d2878-e5f3-47d1-8327-3282ce8dff8f tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f.89f4b894-07bc-43ef-8449-91a06c16cf9f 1G" returned: 0 in 0.533s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-972d2878-e5f3-47d1-8327-3282ce8dff8f tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f.89f4b894-07bc-43ef-8449-91a06c16cf9f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:01 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-95871a80-157d-4b88-801f-5ef33be64774 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.320s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:01 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-95871a80-157d-4b88-801f-5ef33be64774 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:25:01 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-95871a80-157d-4b88-801f-5ef33be64774 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Deleted volume successfully. Jul 21 02:25:01 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f.89f4b894-07bc-43ef-8449-91a06c16cf9f Jul 21 02:25:01 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-95871a80-157d-4b88-801f-5ef33be64774 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "cinder-c13f072c-da78-4a8a-918c-3602b3f082a0-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:01 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ce3f19f8-16f0-4ac3-9a63-7550cd08119d tempest-VolumeDependencyTests-113875028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb.6b427ac9-2dd8-438c-8696-7a3226e1c58c" returned: 0 in 0.438s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ce3f19f8-16f0-4ac3-9a63-7550cd08119d tempest-VolumeDependencyTests-113875028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb.6b427ac9-2dd8-438c-8696-7a3226e1c58c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:01 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb.6b427ac9-2dd8-438c-8696-7a3226e1c58c Jul 21 02:25:01 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:01 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ce3f19f8-16f0-4ac3-9a63-7550cd08119d tempest-VolumeDependencyTests-113875028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb.6b427ac9-2dd8-438c-8696-7a3226e1c58c" returned: 0 in 0.266s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:01 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-972d2878-e5f3-47d1-8327-3282ce8dff8f tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f.89f4b894-07bc-43ef-8449-91a06c16cf9f" returned: 0 in 0.389s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:01 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-972d2878-e5f3-47d1-8327-3282ce8dff8f tempest-CreateVolumesFromSnapshotTest-797281576 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f.89f4b894-07bc-43ef-8449-91a06c16cf9f is being set with open permissions: ugo+rw Jul 21 02:25:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-972d2878-e5f3-47d1-8327-3282ce8dff8f tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f.89f4b894-07bc-43ef-8449-91a06c16cf9f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ce3f19f8-16f0-4ac3-9a63-7550cd08119d tempest-VolumeDependencyTests-113875028 None] Lock "cinder-quobyte-6b427ac9-2dd8-438c-8696-7a3226e1c58c" released by "_delete_snapshot" :: held 1.848s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ce3f19f8-16f0-4ac3-9a63-7550cd08119d tempest-VolumeDependencyTests-113875028 None] Lock "cinder-quobyte-412c9fe6-be9c-49da-8620-08181cb16efb" released by "delete_snapshot" :: held 1.888s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:01 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f.89f4b894-07bc-43ef-8449-91a06c16cf9f Jul 21 02:25:01 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:01 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-ce3f19f8-16f0-4ac3-9a63-7550cd08119d tempest-VolumeDependencyTests-113875028 None] Created reservations ['ed7e3aea-5ad9-403b-a9d2-c7cbdfe1e788', '734704fa-be3f-4751-8406-16002e9eef86', 'e92aec2e-8bd3-4480-bb52-52123b36f02b', '965c27ab-144d-4003-ba08-f4eceb508ea8'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:01 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-ce3f19f8-16f0-4ac3-9a63-7550cd08119d tempest-VolumeDependencyTests-113875028 None] Delete snapshot completed successfully. Jul 21 02:25:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ce3f19f8-16f0-4ac3-9a63-7550cd08119d tempest-VolumeDependencyTests-113875028 None] Lock "cinder-6b427ac9-2dd8-438c-8696-7a3226e1c58c-delete_snapshot" released by "delete_snapshot" :: held 2.066s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-87cfaeae-68d1-447a-b146-a909a860d5f7 tempest-VolumeDependencyTests-113875028 None] Acquiring lock "cinder-412c9fe6-be9c-49da-8620-08181cb16efb-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:01 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-972d2878-e5f3-47d1-8327-3282ce8dff8f tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f.89f4b894-07bc-43ef-8449-91a06c16cf9f" returned: 0 in 0.300s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-87cfaeae-68d1-447a-b146-a909a860d5f7 tempest-VolumeDependencyTests-113875028 None] Lock "cinder-412c9fe6-be9c-49da-8620-08181cb16efb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-87cfaeae-68d1-447a-b146-a909a860d5f7 tempest-VolumeDependencyTests-113875028 None] Acquiring lock "cinder-quobyte-412c9fe6-be9c-49da-8620-08181cb16efb" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-972d2878-e5f3-47d1-8327-3282ce8dff8f tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-87cfaeae-68d1-447a-b146-a909a860d5f7 tempest-VolumeDependencyTests-113875028 None] Lock "cinder-quobyte-412c9fe6-be9c-49da-8620-08181cb16efb" acquired by "delete_volume" :: waited 0.047s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:01 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f.info Jul 21 02:25:01 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4212465e-bc11-4210-863f-5c74f6cc0757 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Acquiring lock "cinder-f2d7a218-19e6-498b-add4-bc9b1a19dcec-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4212465e-bc11-4210-863f-5c74f6cc0757 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "cinder-f2d7a218-19e6-498b-add4-bc9b1a19dcec-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:01 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ffa87b-c537-4f70-a54f-1c3fb86f5d96]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-87cfaeae-68d1-447a-b146-a909a860d5f7 tempest-VolumeDependencyTests-113875028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4212465e-bc11-4210-863f-5c74f6cc0757 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Acquiring lock "cinder-quobyte-f2d7a218-19e6-498b-add4-bc9b1a19dcec" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4212465e-bc11-4210-863f-5c74f6cc0757 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "cinder-quobyte-f2d7a218-19e6-498b-add4-bc9b1a19dcec" acquired by "delete_volume" :: waited 0.018s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:02 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d9423a-b212-4517-a7cb-272e06ca1730]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4212465e-bc11-4210-863f-5c74f6cc0757 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f2d7a218-19e6-498b-add4-bc9b1a19dcec {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:02 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb Jul 21 02:25:02 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:02 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f2d7a218-19e6-498b-add4-bc9b1a19dcec Jul 21 02:25:02 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:02 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-972d2878-e5f3-47d1-8327-3282ce8dff8f tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f.info" returned: 0 in 0.352s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:02 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-972d2878-e5f3-47d1-8327-3282ce8dff8f tempest-CreateVolumesFromSnapshotTest-797281576 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f.info is being set with open permissions: ugo+rw Jul 21 02:25:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-972d2878-e5f3-47d1-8327-3282ce8dff8f tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:02 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f.info Jul 21 02:25:02 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:02 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-87cfaeae-68d1-447a-b146-a909a860d5f7 tempest-VolumeDependencyTests-113875028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb" returned: 0 in 0.456s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-87cfaeae-68d1-447a-b146-a909a860d5f7 tempest-VolumeDependencyTests-113875028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:02 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb Jul 21 02:25:02 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:02 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4212465e-bc11-4210-863f-5c74f6cc0757 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f2d7a218-19e6-498b-add4-bc9b1a19dcec" returned: 0 in 0.417s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4212465e-bc11-4210-863f-5c74f6cc0757 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f2d7a218-19e6-498b-add4-bc9b1a19dcec {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:02 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f2d7a218-19e6-498b-add4-bc9b1a19dcec Jul 21 02:25:02 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:02 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-972d2878-e5f3-47d1-8327-3282ce8dff8f tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f.info" returned: 0 in 0.315s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-972d2878-e5f3-47d1-8327-3282ce8dff8f tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.557s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:02 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-972d2878-e5f3-47d1-8327-3282ce8dff8f tempest-CreateVolumesFromSnapshotTest-797281576 None] Create snapshot completed successfully Jul 21 02:25:02 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-87cfaeae-68d1-447a-b146-a909a860d5f7 tempest-VolumeDependencyTests-113875028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-412c9fe6-be9c-49da-8620-08181cb16efb" returned: 0 in 0.305s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:02 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-87cfaeae-68d1-447a-b146-a909a860d5f7 tempest-VolumeDependencyTests-113875028 None] Lock "cinder-quobyte-412c9fe6-be9c-49da-8620-08181cb16efb" released by "delete_volume" :: held 0.858s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:02 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4212465e-bc11-4210-863f-5c74f6cc0757 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-f2d7a218-19e6-498b-add4-bc9b1a19dcec" returned: 0 in 0.283s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:02 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4212465e-bc11-4210-863f-5c74f6cc0757 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "cinder-quobyte-f2d7a218-19e6-498b-add4-bc9b1a19dcec" released by "delete_volume" :: held 0.764s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:02 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-87cfaeae-68d1-447a-b146-a909a860d5f7 tempest-VolumeDependencyTests-113875028 None] Created reservations ['e23d9535-7c7f-47d3-b6f2-a2ce75f680e4', 'af121097-b477-485a-aeb1-d846b950eeb4', '5caf73f0-a433-47b8-9cc1-6b640224a3ec', 'fec24076-7c99-48f5-bfcc-590349fe6d28'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:02 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-4212465e-bc11-4210-863f-5c74f6cc0757 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Created reservations ['5e71ddcc-ade7-4dca-836a-395d999bafc8', '4895e982-8e56-4ca2-a82d-10b6e594b388', 'c43b7ca5-3d52-4638-9c83-60f4d2626786', '3336097e-928c-4ef9-aeb2-ab98403e1674'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-87cfaeae-68d1-447a-b146-a909a860d5f7 tempest-VolumeDependencyTests-113875028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-87cfaeae-68d1-447a-b146-a909a860d5f7 tempest-VolumeDependencyTests-113875028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:02 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-87cfaeae-68d1-447a-b146-a909a860d5f7 tempest-VolumeDependencyTests-113875028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:02 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-87cfaeae-68d1-447a-b146-a909a860d5f7 tempest-VolumeDependencyTests-113875028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-87cfaeae-68d1-447a-b146-a909a860d5f7 tempest-VolumeDependencyTests-113875028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-87cfaeae-68d1-447a-b146-a909a860d5f7 tempest-VolumeDependencyTests-113875028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:02 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:25:02 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:02 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-dff4b702-5a48-4c47-8d3b-b6ca428b2964 tempest-VolumeDependencyTests-113875028 None] Acquiring lock "cinder-eaa893c0-70b9-4062-9373-10feac406699-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4212465e-bc11-4210-863f-5c74f6cc0757 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4212465e-bc11-4210-863f-5c74f6cc0757 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:02 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4212465e-bc11-4210-863f-5c74f6cc0757 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:02 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4212465e-bc11-4210-863f-5c74f6cc0757 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4212465e-bc11-4210-863f-5c74f6cc0757 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4212465e-bc11-4210-863f-5c74f6cc0757 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:02 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-dff4b702-5a48-4c47-8d3b-b6ca428b2964 tempest-VolumeDependencyTests-113875028 None] Lock "cinder-eaa893c0-70b9-4062-9373-10feac406699-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:02 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:25:02 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-dff4b702-5a48-4c47-8d3b-b6ca428b2964 tempest-VolumeDependencyTests-113875028 None] Acquiring lock "cinder-quobyte-eaa893c0-70b9-4062-9373-10feac406699" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-dff4b702-5a48-4c47-8d3b-b6ca428b2964 tempest-VolumeDependencyTests-113875028 None] Lock "cinder-quobyte-eaa893c0-70b9-4062-9373-10feac406699" acquired by "delete_volume" :: waited 0.027s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:03 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4ef1ec-48b6-4424-a324-b0efe82defda]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dff4b702-5a48-4c47-8d3b-b6ca428b2964 tempest-VolumeDependencyTests-113875028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-eaa893c0-70b9-4062-9373-10feac406699 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:03 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4212465e-bc11-4210-863f-5c74f6cc0757 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.309s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:03 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-4212465e-bc11-4210-863f-5c74f6cc0757 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:25:03 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-4212465e-bc11-4210-863f-5c74f6cc0757 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Deleted volume successfully. Jul 21 02:25:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4212465e-bc11-4210-863f-5c74f6cc0757 tempest-CreateVolumesFromSourceVolumeTest-1257482049 None] Lock "cinder-f2d7a218-19e6-498b-add4-bc9b1a19dcec-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:03 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-87cfaeae-68d1-447a-b146-a909a860d5f7 tempest-VolumeDependencyTests-113875028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.464s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:03 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-87cfaeae-68d1-447a-b146-a909a860d5f7 tempest-VolumeDependencyTests-113875028 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:25:03 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-eaa893c0-70b9-4062-9373-10feac406699 Jul 21 02:25:03 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:03 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-87cfaeae-68d1-447a-b146-a909a860d5f7 tempest-VolumeDependencyTests-113875028 None] Deleted volume successfully. Jul 21 02:25:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-87cfaeae-68d1-447a-b146-a909a860d5f7 tempest-VolumeDependencyTests-113875028 None] Lock "cinder-412c9fe6-be9c-49da-8620-08181cb16efb-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:03 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dff4b702-5a48-4c47-8d3b-b6ca428b2964 tempest-VolumeDependencyTests-113875028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-eaa893c0-70b9-4062-9373-10feac406699" returned: 0 in 0.513s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dff4b702-5a48-4c47-8d3b-b6ca428b2964 tempest-VolumeDependencyTests-113875028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-eaa893c0-70b9-4062-9373-10feac406699 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:03 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-eaa893c0-70b9-4062-9373-10feac406699 Jul 21 02:25:03 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:03 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:25:03 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] Flow 'volume_create_manager' (c95a36d5-6083-4fcd-ae35-c871df5be37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:03 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7144aef0-ddce-4369-b528-994f73df1106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:03 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7144aef0-ddce-4369-b528-994f73df1106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1654074817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc6cbb77-238f-4e91-8986-5b857029d166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2e738c4a3c49718d666de7e06fe282',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:04Z,use_quota=True,user_id='08723b60f0dc4615b1a183502e6558f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:03 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a01e225-11be-444d-9e74-a87c2b121de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:03 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a01e225-11be-444d-9e74-a87c2b121de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:03 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9d96e0b-e873-4f97-b026-ddb70d443bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:03 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9d96e0b-e873-4f97-b026-ddb70d443bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc6cbb77-238f-4e91-8986-5b857029d166', 'volume_name': 'volume-cc6cbb77-238f-4e91-8986-5b857029d166', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:03 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:03 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d02be16f-3604-4b68-8fe6-2b55001f8889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:03 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d02be16f-3604-4b68-8fe6-2b55001f8889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:03 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca98c9d9-4c2c-4d2e-a590-8960948f0283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:03 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] Volume cc6cbb77-238f-4e91-8986-5b857029d166: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc6cbb77-238f-4e91-8986-5b857029d166', 'volume_size': 1} Jul 21 02:25:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:03 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1654074817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc6cbb77-238f-4e91-8986-5b857029d166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2e738c4a3c49718d666de7e06fe282',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:04Z,use_quota=True,user_id='08723b60f0dc4615b1a183502e6558f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:25:03 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] Creating volume cc6cbb77-238f-4e91-8986-5b857029d166 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:25:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:04 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:04 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:04 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:25:04 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:25:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cc6cbb77-238f-4e91-8986-5b857029d166 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dff4b702-5a48-4c47-8d3b-b6ca428b2964 tempest-VolumeDependencyTests-113875028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-eaa893c0-70b9-4062-9373-10feac406699" returned: 0 in 0.386s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:04 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-dff4b702-5a48-4c47-8d3b-b6ca428b2964 tempest-VolumeDependencyTests-113875028 None] Lock "cinder-quobyte-eaa893c0-70b9-4062-9373-10feac406699" released by "delete_volume" :: held 0.981s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:04 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cc6cbb77-238f-4e91-8986-5b857029d166 1073741824 Jul 21 02:25:04 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:04 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-dff4b702-5a48-4c47-8d3b-b6ca428b2964 tempest-VolumeDependencyTests-113875028 None] Created reservations ['09fceca4-18e2-4a15-8e6b-97b6d452a07f', 'e32046fd-c049-4115-9f6d-66b4129c364f', 'a241a623-f6cd-41bb-bfae-e6e2ef986c4e', 'cf7d5e47-8803-4fed-8539-eeb35a803f5f'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dff4b702-5a48-4c47-8d3b-b6ca428b2964 tempest-VolumeDependencyTests-113875028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dff4b702-5a48-4c47-8d3b-b6ca428b2964 tempest-VolumeDependencyTests-113875028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:04 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dff4b702-5a48-4c47-8d3b-b6ca428b2964 tempest-VolumeDependencyTests-113875028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:04 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dff4b702-5a48-4c47-8d3b-b6ca428b2964 tempest-VolumeDependencyTests-113875028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dff4b702-5a48-4c47-8d3b-b6ca428b2964 tempest-VolumeDependencyTests-113875028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dff4b702-5a48-4c47-8d3b-b6ca428b2964 tempest-VolumeDependencyTests-113875028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:04 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:25:04 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:04 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:25:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] Flow 'volume_create_manager' (49a2b011-c141-46b0-848d-97b0b703e5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0692b955-feb6-47ab-91a3-aa8c96a94fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0692b955-feb6-47ab-91a3-aa8c96a94fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1387946707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd0e017-da35-4dcf-8c43-456b1785fd66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2e738c4a3c49718d666de7e06fe282',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:04Z,use_quota=True,user_id='08723b60f0dc4615b1a183502e6558f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48120706-69f7-450e-a68c-8217d27be4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48120706-69f7-450e-a68c-8217d27be4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef3d99ad-45c5-45cd-8334-90dc971fec39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef3d99ad-45c5-45cd-8334-90dc971fec39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfd0e017-da35-4dcf-8c43-456b1785fd66', 'volume_name': 'volume-dfd0e017-da35-4dcf-8c43-456b1785fd66', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (578cc788-4cda-4ac3-879c-1bae48d6f387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (578cc788-4cda-4ac3-879c-1bae48d6f387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:04 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b84b842d-23c3-45ab-ab82-d5a483793b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:04 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] Volume dfd0e017-da35-4dcf-8c43-456b1785fd66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfd0e017-da35-4dcf-8c43-456b1785fd66', 'volume_size': 1} Jul 21 02:25:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:04 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dff4b702-5a48-4c47-8d3b-b6ca428b2964 tempest-VolumeDependencyTests-113875028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.400s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:04 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-dff4b702-5a48-4c47-8d3b-b6ca428b2964 tempest-VolumeDependencyTests-113875028 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:25:04 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-dff4b702-5a48-4c47-8d3b-b6ca428b2964 tempest-VolumeDependencyTests-113875028 None] Deleted volume successfully. Jul 21 02:25:04 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-dff4b702-5a48-4c47-8d3b-b6ca428b2964 tempest-VolumeDependencyTests-113875028 None] Lock "cinder-eaa893c0-70b9-4062-9373-10feac406699-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:04 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cc6cbb77-238f-4e91-8986-5b857029d166 1073741824" returned: 0 in 0.799s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cc6cbb77-238f-4e91-8986-5b857029d166 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:04 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cc6cbb77-238f-4e91-8986-5b857029d166 Jul 21 02:25:04 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:04 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Flow 'volume_create_manager' (ac16be59-6340-463c-a80b-610a1464d580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29e28a6b-591a-462a-a8fc-01382508a94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29e28a6b-591a-462a-a8fc-01382508a94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1576441714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c0ffc08-0722-40cd-823a-1f3218fdacad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2e738c4a3c49718d666de7e06fe282',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:05Z,use_quota=True,user_id='08723b60f0dc4615b1a183502e6558f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e66a9f36-9224-4558-968d-47199a832dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e66a9f36-9224-4558-968d-47199a832dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b91f0c8-66c7-4594-94f9-68a8cf96d709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b91f0c8-66c7-4594-94f9-68a8cf96d709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c0ffc08-0722-40cd-823a-1f3218fdacad', 'volume_name': 'volume-7c0ffc08-0722-40cd-823a-1f3218fdacad', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e4602a5-138e-4114-9bba-dfc1f6937487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e4602a5-138e-4114-9bba-dfc1f6937487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:05 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (080a3327-6cd1-4434-af8b-1e347cd206ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:05 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Volume 7c0ffc08-0722-40cd-823a-1f3218fdacad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c0ffc08-0722-40cd-823a-1f3218fdacad', 'volume_size': 1} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cc6cbb77-238f-4e91-8986-5b857029d166" returned: 0 in 0.316s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.570s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1387946707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd0e017-da35-4dcf-8c43-456b1785fd66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2e738c4a3c49718d666de7e06fe282',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:04Z,use_quota=True,user_id='08723b60f0dc4615b1a183502e6558f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] Creating volume dfd0e017-da35-4dcf-8c43-456b1785fd66 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:25:05 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-dfd0e017-da35-4dcf-8c43-456b1785fd66 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca98c9d9-4c2c-4d2e-a590-8960948f0283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc6cbb77-238f-4e91-8986-5b857029d166', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba4d3362-5b4c-4399-b725-cde5d08372c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:05 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-dfd0e017-da35-4dcf-8c43-456b1785fd66 1073741824 Jul 21 02:25:05 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:05 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] Volume volume-cc6cbb77-238f-4e91-8986-5b857029d166 (cc6cbb77-238f-4e91-8986-5b857029d166): created successfully Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba4d3362-5b4c-4399-b725-cde5d08372c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] Flow 'volume_create_manager' (c95a36d5-6083-4fcd-ae35-c871df5be37d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:05 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-c563f936-d641-415a-8dd9-e54363a556f5 tempest-CreateVolumesFromSnapshotTest-797281576 None] Created volume successfully. Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] Flow 'volume_create_manager' (55031eb4-5ce8-45b4-8051-615eb68a6df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0380fc80-2098-47c9-ae6c-65f0d89f8552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0380fc80-2098-47c9-ae6c-65f0d89f8552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1175798155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=095f45a1-b8fa-48a6-99c0-a645c25d5300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2e738c4a3c49718d666de7e06fe282',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:05Z,use_quota=True,user_id='08723b60f0dc4615b1a183502e6558f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00cc1a04-5c9d-4357-b2c7-75f0daa55594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00cc1a04-5c9d-4357-b2c7-75f0daa55594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (801e206d-3ace-4cf6-bffe-85fb68c3ed71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (801e206d-3ace-4cf6-bffe-85fb68c3ed71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '095f45a1-b8fa-48a6-99c0-a645c25d5300', 'volume_name': 'volume-095f45a1-b8fa-48a6-99c0-a645c25d5300', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb81c991-93a2-4347-98fd-0dc39b721e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb81c991-93a2-4347-98fd-0dc39b721e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f14b9c-9262-4f95-a865-ac1eb0d1bbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:05 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] Volume 095f45a1-b8fa-48a6-99c0-a645c25d5300: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-095f45a1-b8fa-48a6-99c0-a645c25d5300', 'volume_size': 1} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:05 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-dfd0e017-da35-4dcf-8c43-456b1785fd66 1073741824" returned: 0 in 0.746s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-dfd0e017-da35-4dcf-8c43-456b1785fd66 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:06 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-dfd0e017-da35-4dcf-8c43-456b1785fd66 Jul 21 02:25:06 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] Flow 'volume_create_manager' (f17bfd60-6a34-4c78-9a0f-bdc6e6e63733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2abfe8ae-2b3c-4c3e-a899-aaa6ca6d4cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] Flow 'volume_create_manager' (d82c204d-6909-4a11-929a-6653fb9d8790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (870a7563-c3e0-45d2-b900-4b6639814273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2abfe8ae-2b3c-4c3e-a899-aaa6ca6d4cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1359352863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0bd31d4-c1db-424e-bbe1-3ee3a7134aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9180fe803c342ad96c373b69434c36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:06Z,use_quota=True,user_id='33a1095c5e17461e8e8a710d76a95247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa42747d-eeed-4d52-b238-cbab5c42e52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa42747d-eeed-4d52-b238-cbab5c42e52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:06 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2344d4ef-bb32-40cd-a792-1873feef74f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2344d4ef-bb32-40cd-a792-1873feef74f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0bd31d4-c1db-424e-bbe1-3ee3a7134aab', 'volume_name': 'volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf85a4c0-a577-4fc5-9303-771765301e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf85a4c0-a577-4fc5-9303-771765301e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac92dbfe-6c50-41cc-907b-a8948c5350b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:06 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] Volume e0bd31d4-c1db-424e-bbe1-3ee3a7134aab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab', 'volume_size': 1} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (870a7563-c3e0-45d2-b900-4b6639814273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-621166977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c5be8f-9fd1-4642-9dc6-e24077fb7ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2e738c4a3c49718d666de7e06fe282',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:06Z,use_quota=True,user_id='08723b60f0dc4615b1a183502e6558f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e133b7-e99e-4906-a120-15f88ea8302c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e133b7-e99e-4906-a120-15f88ea8302c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad6051e0-367d-44ad-bdbe-ba7eb0944d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad6051e0-367d-44ad-bdbe-ba7eb0944d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30c5be8f-9fd1-4642-9dc6-e24077fb7ea3', 'volume_name': 'volume-30c5be8f-9fd1-4642-9dc6-e24077fb7ea3', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8422cc61-2cfb-4f1c-af8c-9f99bf45b304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8422cc61-2cfb-4f1c-af8c-9f99bf45b304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d4d034-974c-4f5d-aad4-229500b264b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:06 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] Volume 30c5be8f-9fd1-4642-9dc6-e24077fb7ea3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30c5be8f-9fd1-4642-9dc6-e24077fb7ea3', 'volume_size': 1} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-dfd0e017-da35-4dcf-8c43-456b1785fd66" returned: 0 in 0.427s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.265s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1576441714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c0ffc08-0722-40cd-823a-1f3218fdacad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2e738c4a3c49718d666de7e06fe282',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:05Z,use_quota=True,user_id='08723b60f0dc4615b1a183502e6558f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Creating volume 7c0ffc08-0722-40cd-823a-1f3218fdacad {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:25:06 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7c0ffc08-0722-40cd-823a-1f3218fdacad 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b84b842d-23c3-45ab-ab82-d5a483793b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfd0e017-da35-4dcf-8c43-456b1785fd66', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:06 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7c0ffc08-0722-40cd-823a-1f3218fdacad 1073741824 Jul 21 02:25:06 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8183672f-aab4-4032-ad88-fdc8f5932810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:06 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] Volume volume-dfd0e017-da35-4dcf-8c43-456b1785fd66 (dfd0e017-da35-4dcf-8c43-456b1785fd66): created successfully Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8183672f-aab4-4032-ad88-fdc8f5932810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] Flow 'volume_create_manager' (49a2b011-c141-46b0-848d-97b0b703e5e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:06 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-4d8931a1-3899-4873-ab69-80ce1a404e10 tempest-CreateVolumesFromSnapshotTest-797281576 None] Created volume successfully. Jul 21 02:25:06 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7c0ffc08-0722-40cd-823a-1f3218fdacad 1073741824" returned: 0 in 0.511s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7c0ffc08-0722-40cd-823a-1f3218fdacad {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:07 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7c0ffc08-0722-40cd-823a-1f3218fdacad Jul 21 02:25:07 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:07 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7c0ffc08-0722-40cd-823a-1f3218fdacad" returned: 0 in 0.261s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:07 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:25:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.481s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:07 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1175798155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=095f45a1-b8fa-48a6-99c0-a645c25d5300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2e738c4a3c49718d666de7e06fe282',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:05Z,use_quota=True,user_id='08723b60f0dc4615b1a183502e6558f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:25:07 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] Creating volume 095f45a1-b8fa-48a6-99c0-a645c25d5300 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:25:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:07 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:07 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:07 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:25:07 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:25:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-095f45a1-b8fa-48a6-99c0-a645c25d5300 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (080a3327-6cd1-4434-af8b-1e347cd206ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c0ffc08-0722-40cd-823a-1f3218fdacad', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa5475cd-3a71-4671-9133-b54b5596af4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:07 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-095f45a1-b8fa-48a6-99c0-a645c25d5300 1073741824 Jul 21 02:25:07 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:07 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Volume volume-7c0ffc08-0722-40cd-823a-1f3218fdacad (7c0ffc08-0722-40cd-823a-1f3218fdacad): created successfully Jul 21 02:25:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa5475cd-3a71-4671-9133-b54b5596af4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Flow 'volume_create_manager' (ac16be59-6340-463c-a80b-610a1464d580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:07 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-ca617259-6a1b-46c2-8410-862cc4a9f2b9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Created volume successfully. Jul 21 02:25:07 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-095f45a1-b8fa-48a6-99c0-a645c25d5300 1073741824" returned: 0 in 0.499s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:07 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:25:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] Flow 'volume_create_manager' (86fc13a7-5d4e-48f2-9d1f-039ebcf56cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff90325e-ddd7-422b-9826-12329f94ebaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff90325e-ddd7-422b-9826-12329f94ebaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb482386-984e-455b-9d31-bf9d229f2c9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e13b31b0c7b4b828fb2b0113cc45bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:08Z,use_quota=True,user_id='68999010f37f421f93bf5f511fc69d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a564f1f-0953-4cab-b9a3-aa47119c072f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a564f1f-0953-4cab-b9a3-aa47119c072f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0350f090-931c-4472-98b2-b7c5e47055d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0350f090-931c-4472-98b2-b7c5e47055d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb482386-984e-455b-9d31-bf9d229f2c9f', 'volume_name': 'volume-fb482386-984e-455b-9d31-bf9d229f2c9f', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97723d11-7d9f-4b68-b922-69546d2edd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97723d11-7d9f-4b68-b922-69546d2edd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:07 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e679e56-2787-4ef2-b867-33f0d76a31ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:07 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] Volume fb482386-984e-455b-9d31-bf9d229f2c9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb482386-984e-455b-9d31-bf9d229f2c9f', 'volume_size': 1} Jul 21 02:25:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-095f45a1-b8fa-48a6-99c0-a645c25d5300 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:07 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-095f45a1-b8fa-48a6-99c0-a645c25d5300 Jul 21 02:25:07 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:08 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-095f45a1-b8fa-48a6-99c0-a645c25d5300" returned: 0 in 0.256s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.748s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1359352863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0bd31d4-c1db-424e-bbe1-3ee3a7134aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9180fe803c342ad96c373b69434c36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:06Z,use_quota=True,user_id='33a1095c5e17461e8e8a710d76a95247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] Creating volume e0bd31d4-c1db-424e-bbe1-3ee3a7134aab {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:25:08 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f14b9c-9262-4f95-a865-ac1eb0d1bbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-095f45a1-b8fa-48a6-99c0-a645c25d5300', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:08 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab 1073741824 Jul 21 02:25:08 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e1f2c5-92bd-4a8c-9ec9-bd09c9102849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:08 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] Volume volume-095f45a1-b8fa-48a6-99c0-a645c25d5300 (095f45a1-b8fa-48a6-99c0-a645c25d5300): created successfully Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e1f2c5-92bd-4a8c-9ec9-bd09c9102849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] Flow 'volume_create_manager' (55031eb4-5ce8-45b4-8051-615eb68a6df4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:08 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-cd8106d4-d1e0-4184-a7e3-721e50077bc1 tempest-CreateVolumesFromSnapshotTest-797281576 None] Created volume successfully. Jul 21 02:25:08 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab 1073741824" returned: 0 in 0.468s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:08 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab Jul 21 02:25:08 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:08 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab" returned: 0 in 0.266s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.494s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-621166977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c5be8f-9fd1-4642-9dc6-e24077fb7ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2e738c4a3c49718d666de7e06fe282',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:06Z,use_quota=True,user_id='08723b60f0dc4615b1a183502e6558f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] Creating volume 30c5be8f-9fd1-4642-9dc6-e24077fb7ea3 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:25:08 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-30c5be8f-9fd1-4642-9dc6-e24077fb7ea3 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac92dbfe-6c50-41cc-907b-a8948c5350b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b63b7dcd-5e96-4613-b2b7-06d560d5c503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:08 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-30c5be8f-9fd1-4642-9dc6-e24077fb7ea3 1073741824 Jul 21 02:25:08 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:08 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] Volume volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab (e0bd31d4-c1db-424e-bbe1-3ee3a7134aab): created successfully Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b63b7dcd-5e96-4613-b2b7-06d560d5c503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:08 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] Flow 'volume_create_manager' (f17bfd60-6a34-4c78-9a0f-bdc6e6e63733) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:08 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-2d3a8f3d-3122-43d1-8d30-feea9e8a6e67 tempest-ProjectMemberTests-723363327 None] Created volume successfully. Jul 21 02:25:09 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-30c5be8f-9fd1-4642-9dc6-e24077fb7ea3 1073741824" returned: 0 in 0.521s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-30c5be8f-9fd1-4642-9dc6-e24077fb7ea3 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:09 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-30c5be8f-9fd1-4642-9dc6-e24077fb7ea3 Jul 21 02:25:09 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0cc06cb6-7fdb-41e6-a9dc-1471534a73f0 tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:09 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-30c5be8f-9fd1-4642-9dc6-e24077fb7ea3" returned: 0 in 0.264s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:09 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:25:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.904s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:09 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb482386-984e-455b-9d31-bf9d229f2c9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e13b31b0c7b4b828fb2b0113cc45bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:08Z,use_quota=True,user_id='68999010f37f421f93bf5f511fc69d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:25:09 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] Creating volume fb482386-984e-455b-9d31-bf9d229f2c9f {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:25:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:09 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:09 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:09 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:25:09 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:25:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fb482386-984e-455b-9d31-bf9d229f2c9f 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d4d034-974c-4f5d-aad4-229500b264b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30c5be8f-9fd1-4642-9dc6-e24077fb7ea3', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012d8b0c-a5cc-458a-be8d-75b80881b686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:09 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fb482386-984e-455b-9d31-bf9d229f2c9f 1073741824 Jul 21 02:25:09 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:09 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] Volume volume-30c5be8f-9fd1-4642-9dc6-e24077fb7ea3 (30c5be8f-9fd1-4642-9dc6-e24077fb7ea3): created successfully Jul 21 02:25:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012d8b0c-a5cc-458a-be8d-75b80881b686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] Flow 'volume_create_manager' (d82c204d-6909-4a11-929a-6653fb9d8790) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:09 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-91ca8167-ab9f-4783-bfc3-15080beb267d tempest-CreateVolumesFromSnapshotTest-797281576 None] Created volume successfully. Jul 21 02:25:10 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fb482386-984e-455b-9d31-bf9d229f2c9f 1073741824" returned: 0 in 0.433s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fb482386-984e-455b-9d31-bf9d229f2c9f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:10 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fb482386-984e-455b-9d31-bf9d229f2c9f Jul 21 02:25:10 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:10 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fb482386-984e-455b-9d31-bf9d229f2c9f" returned: 0 in 0.262s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:10 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:25:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0cc06cb6-7fdb-41e6-a9dc-1471534a73f0 tempest-ProjectMemberTests-723363327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.902s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e679e56-2787-4ef2-b867-33f0d76a31ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb482386-984e-455b-9d31-bf9d229f2c9f', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee070727-6ea7-463e-a638-8d6576978df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:10 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-0cc06cb6-7fdb-41e6-a9dc-1471534a73f0 tempest-ProjectMemberTests-723363327 None] Creating offline snapshot 0ce5fe40-805f-4b10-b3da-2f0bd2ad9633 of volume e0bd31d4-c1db-424e-bbe1-3ee3a7134aab {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:25:10 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] Volume volume-fb482386-984e-455b-9d31-bf9d229f2c9f (fb482386-984e-455b-9d31-bf9d229f2c9f): created successfully Jul 21 02:25:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee070727-6ea7-463e-a638-8d6576978df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] Flow 'volume_create_manager' (86fc13a7-5d4e-48f2-9d1f-039ebcf56cf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:10 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d2b96d-5ab3-4e7f-a53f-2e44c3b2e892]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0cc06cb6-7fdb-41e6-a9dc-1471534a73f0 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:10 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-afbf66df-0345-46ff-8010-578b5bc3b62c tempest-CinderUnicodeTest-429463113 None] Created volume successfully. Jul 21 02:25:10 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d67cb3be-d8ce-4176-816c-72bd6296517a tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "cinder-30c5be8f-9fd1-4642-9dc6-e24077fb7ea3-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:10 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d67cb3be-d8ce-4176-816c-72bd6296517a tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "cinder-30c5be8f-9fd1-4642-9dc6-e24077fb7ea3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:10 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d67cb3be-d8ce-4176-816c-72bd6296517a tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "cinder-quobyte-30c5be8f-9fd1-4642-9dc6-e24077fb7ea3" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:10 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab Jul 21 02:25:10 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:10 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d67cb3be-d8ce-4176-816c-72bd6296517a tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "cinder-quobyte-30c5be8f-9fd1-4642-9dc6-e24077fb7ea3" acquired by "delete_volume" :: waited 0.014s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:10 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a7e2cc-dd05-4bbe-96b9-51b30429b11a]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d67cb3be-d8ce-4176-816c-72bd6296517a tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-30c5be8f-9fd1-4642-9dc6-e24077fb7ea3 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:10 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-30c5be8f-9fd1-4642-9dc6-e24077fb7ea3 Jul 21 02:25:10 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:11 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0cc06cb6-7fdb-41e6-a9dc-1471534a73f0 tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab" returned: 0 in 0.479s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0cc06cb6-7fdb-41e6-a9dc-1471534a73f0 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab.0ce5fe40-805f-4b10-b3da-2f0bd2ad9633 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:11 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab.0ce5fe40-805f-4b10-b3da-2f0bd2ad9633 1G Jul 21 02:25:11 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:11 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d67cb3be-d8ce-4176-816c-72bd6296517a tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-30c5be8f-9fd1-4642-9dc6-e24077fb7ea3" returned: 0 in 0.433s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d67cb3be-d8ce-4176-816c-72bd6296517a tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-30c5be8f-9fd1-4642-9dc6-e24077fb7ea3 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:11 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-30c5be8f-9fd1-4642-9dc6-e24077fb7ea3 Jul 21 02:25:11 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:11 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d67cb3be-d8ce-4176-816c-72bd6296517a tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-30c5be8f-9fd1-4642-9dc6-e24077fb7ea3" returned: 0 in 0.366s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:11 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d67cb3be-d8ce-4176-816c-72bd6296517a tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "cinder-quobyte-30c5be8f-9fd1-4642-9dc6-e24077fb7ea3" released by "delete_volume" :: held 0.856s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:11 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-d67cb3be-d8ce-4176-816c-72bd6296517a tempest-CreateVolumesFromSnapshotTest-797281576 None] Created reservations ['803a3541-c99c-4e72-a69a-c71f10e28127', 'ac7a92d8-169d-43e8-94be-7709ed9030d6', '3eb1923e-0b86-42e2-85a0-bbd6a3d2f198', '06eff6e9-d0f1-484a-a4e1-1035521d232e'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:11 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:11 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:25:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] Flow 'volume_create_manager' (010c94f6-7842-4313-bcbb-0e0fb68d8f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b2d6dec-0616-4f89-a93d-f9b4d22a01fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0cc06cb6-7fdb-41e6-a9dc-1471534a73f0 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab.0ce5fe40-805f-4b10-b3da-2f0bd2ad9633 1G" returned: 0 in 0.655s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0cc06cb6-7fdb-41e6-a9dc-1471534a73f0 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab.0ce5fe40-805f-4b10-b3da-2f0bd2ad9633 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b2d6dec-0616-4f89-a93d-f9b4d22a01fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2120195337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1b55550-86b1-46d4-91c8-1120220dedf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e13b31b0c7b4b828fb2b0113cc45bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:12Z,use_quota=True,user_id='68999010f37f421f93bf5f511fc69d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:11 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab.0ce5fe40-805f-4b10-b3da-2f0bd2ad9633 Jul 21 02:25:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ed2ec88-4b9e-4a79-9399-9a1368ae7dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:11 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ed2ec88-4b9e-4a79-9399-9a1368ae7dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b392a97c-6bcd-4a43-a7ae-22c356d6db09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b392a97c-6bcd-4a43-a7ae-22c356d6db09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1b55550-86b1-46d4-91c8-1120220dedf3', 'volume_name': 'volume-b1b55550-86b1-46d4-91c8-1120220dedf3', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86e873c9-3224-442f-9887-78c2d56ef6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86e873c9-3224-442f-9887-78c2d56ef6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:11 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (558e4b90-c2aa-407b-bba5-b4ae96efee62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:11 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] Volume b1b55550-86b1-46d4-91c8-1120220dedf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1b55550-86b1-46d4-91c8-1120220dedf3', 'volume_size': 1} Jul 21 02:25:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d67cb3be-d8ce-4176-816c-72bd6296517a tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d67cb3be-d8ce-4176-816c-72bd6296517a tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:11 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d67cb3be-d8ce-4176-816c-72bd6296517a tempest-CreateVolumesFromSnapshotTest-797281576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:11 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d67cb3be-d8ce-4176-816c-72bd6296517a tempest-CreateVolumesFromSnapshotTest-797281576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d67cb3be-d8ce-4176-816c-72bd6296517a tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d67cb3be-d8ce-4176-816c-72bd6296517a tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:11 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:25:11 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:11 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Flow 'volume_create_manager' (56953b4e-ae75-4802-af0d-e5bb3a6d2d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea8b5422-31cd-4488-bbd2-0cea5c1b3245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea8b5422-31cd-4488-bbd2-0cea5c1b3245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d6d20ce-2e2a-474e-9d26-9c39de53909e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2364396750f3417f9bff48481f82dd42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:12Z,use_quota=True,user_id='3688282f91dd447eb7b9854790bddaeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20382337-27d4-45a0-a8c3-9b661ab5c270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20382337-27d4-45a0-a8c3-9b661ab5c270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1158e937-c755-49a9-8b1b-b32020c5eef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG cinder.image.glance [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Creating Keystone auth plugin from conf {{(pid=87566) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 02:25:12 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0cc06cb6-7fdb-41e6-a9dc-1471534a73f0 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab.0ce5fe40-805f-4b10-b3da-2f0bd2ad9633" returned: 0 in 0.352s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:12 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-0cc06cb6-7fdb-41e6-a9dc-1471534a73f0 tempest-ProjectMemberTests-723363327 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab.0ce5fe40-805f-4b10-b3da-2f0bd2ad9633 is being set with open permissions: ugo+rw Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0cc06cb6-7fdb-41e6-a9dc-1471534a73f0 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab.0ce5fe40-805f-4b10-b3da-2f0bd2ad9633 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:12 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab.0ce5fe40-805f-4b10-b3da-2f0bd2ad9633 Jul 21 02:25:12 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:12 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d67cb3be-d8ce-4176-816c-72bd6296517a tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.277s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-d67cb3be-d8ce-4176-816c-72bd6296517a tempest-CreateVolumesFromSnapshotTest-797281576 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:25:12 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-d67cb3be-d8ce-4176-816c-72bd6296517a tempest-CreateVolumesFromSnapshotTest-797281576 None] Deleted volume successfully. Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d67cb3be-d8ce-4176-816c-72bd6296517a tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "cinder-30c5be8f-9fd1-4642-9dc6-e24077fb7ea3-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1158e937-c755-49a9-8b1b-b32020c5eef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6d6d20ce-2e2a-474e-9d26-9c39de53909e', 'volume_name': 'volume-6d6d20ce-2e2a-474e-9d26-9c39de53909e', 'volume_size': 1, 'image_id': '49e9e10d-a816-4715-9939-4e40c07abad5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49e9e10d-a816-4715-9939-4e40c07abad5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '28fd3661a880f0f3463bd6349b41a432', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2364396750f3417f9bff48481f82dd42', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bf32e302f8f5d11feda2cf269926b6a0601e6f1eb777d0ac52f68f7ee5d217c2ac45a5ea7d8cace23a7a8d2dc5093731e81914952e2b0317d7da050420e62039', 'id': '49e9e10d-a816-4715-9939-4e40c07abad5', 'created_at': datetime.datetime(2026, 7, 21, 0, 25, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 0, 25, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49e9e10d-a816-4715-9939-4e40c07abad5/file', 'properties': {}}, 'image_service': }' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43a6682f-c534-4651-8b03-ff92a584416a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43a6682f-c534-4651-8b03-ff92a584416a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (331e53c1-11c3-479e-b6a5-98425e3f5ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:12 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Volume 6d6d20ce-2e2a-474e-9d26-9c39de53909e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6d6d20ce-2e2a-474e-9d26-9c39de53909e', 'volume_size': 1, 'image_id': '49e9e10d-a816-4715-9939-4e40c07abad5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49e9e10d-a816-4715-9939-4e40c07abad5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '28fd3661a880f0f3463bd6349b41a432', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2364396750f3417f9bff48481f82dd42', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bf32e302f8f5d11feda2cf269926b6a0601e6f1eb777d0ac52f68f7ee5d217c2ac45a5ea7d8cace23a7a8d2dc5093731e81914952e2b0317d7da050420e62039', 'id': '49e9e10d-a816-4715-9939-4e40c07abad5', 'created_at': datetime.datetime(2026, 7, 21, 0, 25, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 0, 25, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49e9e10d-a816-4715-9939-4e40c07abad5/file', 'properties': {}}, 'image_service': } Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Trying to clone 6d6d20ce-2e2a-474e-9d26-9c39de53909e from image 49e9e10d-a816-4715-9939-4e40c07abad5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/49e9e10d-a816-4715-9939-4e40c07abad5', 'metadata': {}}]). {{(pid=87566) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 02:25:12 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0cc06cb6-7fdb-41e6-a9dc-1471534a73f0 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab.0ce5fe40-805f-4b10-b3da-2f0bd2ad9633" returned: 0 in 0.262s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0cc06cb6-7fdb-41e6-a9dc-1471534a73f0 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_49e9e10d-a816-4715-9939-4e40c07abad5_65va4scqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87566) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 02:25:12 devstack cinder-volume[87566]: INFO cinder.image.image_utils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Image download 0.00 MB at 0.00 MB/s Jul 21 02:25:12 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab.info Jul 21 02:25:12 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cd98ea-2c55-4cd6-ab48-6cbb331b2df0]: (4, 'raw') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49e9e10d-a816-4715-9939-4e40c07abad5_65va4scqdevstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:12 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49e9e10d-a816-4715-9939-4e40c07abad5_65va4scqdevstack@QuobyteHD Jul 21 02:25:12 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:12 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0cc06cb6-7fdb-41e6-a9dc-1471534a73f0 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab.info" returned: 0 in 0.261s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:12 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-0cc06cb6-7fdb-41e6-a9dc-1471534a73f0 tempest-ProjectMemberTests-723363327 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab.info is being set with open permissions: ugo+rw Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0cc06cb6-7fdb-41e6-a9dc-1471534a73f0 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:12 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab.info Jul 21 02:25:12 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:12 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49e9e10d-a816-4715-9939-4e40c07abad5_65va4scqdevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49e9e10d-a816-4715-9939-4e40c07abad5_65va4scqdevstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-524f515c-a07f-401b-bf60-604c984e3382 tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "cinder-095f45a1-b8fa-48a6-99c0-a645c25d5300-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:12 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-524f515c-a07f-401b-bf60-604c984e3382 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "cinder-095f45a1-b8fa-48a6-99c0-a645c25d5300-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-0cc06cb6-7fdb-41e6-a9dc-1471534a73f0 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab.info" returned: 0 in 0.282s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:12 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49e9e10d-a816-4715-9939-4e40c07abad5_65va4scqdevstack@QuobyteHD Jul 21 02:25:12 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-0cc06cb6-7fdb-41e6-a9dc-1471534a73f0 tempest-ProjectMemberTests-723363327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.438s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.153s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2120195337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1b55550-86b1-46d4-91c8-1120220dedf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e13b31b0c7b4b828fb2b0113cc45bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:12Z,use_quota=True,user_id='68999010f37f421f93bf5f511fc69d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] Creating volume b1b55550-86b1-46d4-91c8-1120220dedf3 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:25:12 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:25:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:12 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3 1073741824 Jul 21 02:25:12 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:13 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-0cc06cb6-7fdb-41e6-a9dc-1471534a73f0 tempest-ProjectMemberTests-723363327 None] Create snapshot completed successfully Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-524f515c-a07f-401b-bf60-604c984e3382 tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "cinder-quobyte-095f45a1-b8fa-48a6-99c0-a645c25d5300" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-524f515c-a07f-401b-bf60-604c984e3382 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "cinder-quobyte-095f45a1-b8fa-48a6-99c0-a645c25d5300" acquired by "delete_volume" :: waited 0.020s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63a1beb-c92d-4dc4-94c4-1531012068e9]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-524f515c-a07f-401b-bf60-604c984e3382 tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-095f45a1-b8fa-48a6-99c0-a645c25d5300 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:13 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49e9e10d-a816-4715-9939-4e40c07abad5_65va4scqdevstack@QuobyteHD" returned: 1 in 0.370s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49e9e10d-a816-4715-9939-4e40c07abad5_65va4scqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Temporary image 49e9e10d-a816-4715-9939-4e40c07abad5 is fetched for user 3688282f91dd447eb7b9854790bddaeb. {{(pid=87566) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 02:25:13 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-095f45a1-b8fa-48a6-99c0-a645c25d5300 Jul 21 02:25:13 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62d3fbf-2c5c-4cc2-9ef1-f8bf83c9acd7]: (4, 'raw') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49e9e10d-a816-4715-9939-4e40c07abad5_65va4scqdevstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:13 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49e9e10d-a816-4715-9939-4e40c07abad5_65va4scqdevstack@QuobyteHD Jul 21 02:25:13 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:13 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3 1073741824" returned: 0 in 0.455s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:13 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-524f515c-a07f-401b-bf60-604c984e3382 tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-095f45a1-b8fa-48a6-99c0-a645c25d5300" returned: 0 in 0.367s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-524f515c-a07f-401b-bf60-604c984e3382 tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-095f45a1-b8fa-48a6-99c0-a645c25d5300 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:13 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-095f45a1-b8fa-48a6-99c0-a645c25d5300 Jul 21 02:25:13 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:13 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3 Jul 21 02:25:13 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:13 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49e9e10d-a816-4715-9939-4e40c07abad5_65va4scqdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49e9e10d-a816-4715-9939-4e40c07abad5_65va4scqdevstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:13 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49e9e10d-a816-4715-9939-4e40c07abad5_65va4scqdevstack@QuobyteHD Jul 21 02:25:13 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:13 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-524f515c-a07f-401b-bf60-604c984e3382 tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-095f45a1-b8fa-48a6-99c0-a645c25d5300" returned: 0 in 0.254s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-524f515c-a07f-401b-bf60-604c984e3382 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "cinder-quobyte-095f45a1-b8fa-48a6-99c0-a645c25d5300" released by "delete_volume" :: held 0.674s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:13 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3" returned: 0 in 0.306s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-524f515c-a07f-401b-bf60-604c984e3382 tempest-CreateVolumesFromSnapshotTest-797281576 None] Created reservations ['ef99a5e9-094b-4629-a397-05e936785369', 'c68e4497-ed9e-496f-9fd6-1e54198a587f', 'ee9cdd57-df3a-4c82-a639-05dff9495c43', 'c7ec93a4-200f-449e-a276-b38cf5c01989'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (558e4b90-c2aa-407b-bba5-b4ae96efee62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1b55550-86b1-46d4-91c8-1120220dedf3', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1de07ced-a788-4c68-b29a-0c6c03b58a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c0633936-7e3e-4ab3-b7a2-cb885249b804 tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-0ce5fe40-805f-4b10-b3da-2f0bd2ad9633-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:13 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] Volume volume-b1b55550-86b1-46d4-91c8-1120220dedf3 (b1b55550-86b1-46d4-91c8-1120220dedf3): created successfully Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1de07ced-a788-4c68-b29a-0c6c03b58a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] Flow 'volume_create_manager' (010c94f6-7842-4313-bcbb-0e0fb68d8f5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c0633936-7e3e-4ab3-b7a2-cb885249b804 tempest-ProjectMemberTests-723363327 None] Lock "cinder-0ce5fe40-805f-4b10-b3da-2f0bd2ad9633-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c0633936-7e3e-4ab3-b7a2-cb885249b804 tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-quobyte-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:13 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-d84619aa-952f-44d3-9bf3-6ce480986479 tempest-CinderUnicodeTest-429463113 None] Created volume successfully. Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c0633936-7e3e-4ab3-b7a2-cb885249b804 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c0633936-7e3e-4ab3-b7a2-cb885249b804 tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-quobyte-0ce5fe40-805f-4b10-b3da-2f0bd2ad9633" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:13 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49e9e10d-a816-4715-9939-4e40c07abad5_65va4scqdevstack@QuobyteHD" returned: 1 in 0.352s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49e9e10d-a816-4715-9939-4e40c07abad5_65va4scqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d6d20ce-2e2a-474e-9d26-9c39de53909e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2364396750f3417f9bff48481f82dd42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:12Z,use_quota=True,user_id='3688282f91dd447eb7b9854790bddaeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Creating volume 6d6d20ce-2e2a-474e-9d26-9c39de53909e {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:25:13 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6d6d20ce-2e2a-474e-9d26-9c39de53909e 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c0633936-7e3e-4ab3-b7a2-cb885249b804 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-0ce5fe40-805f-4b10-b3da-2f0bd2ad9633" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-c0633936-7e3e-4ab3-b7a2-cb885249b804 tempest-ProjectMemberTests-723363327 None] Deleting offline snapshot 0ce5fe40-805f-4b10-b3da-2f0bd2ad9633 of volume e0bd31d4-c1db-424e-bbe1-3ee3a7134aab {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-c0633936-7e3e-4ab3-b7a2-cb885249b804 tempest-ProjectMemberTests-723363327 None] snapshot_file for this snap is: volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab.0ce5fe40-805f-4b10-b3da-2f0bd2ad9633 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-524f515c-a07f-401b-bf60-604c984e3382 tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-524f515c-a07f-401b-bf60-604c984e3382 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-524f515c-a07f-401b-bf60-604c984e3382 tempest-CreateVolumesFromSnapshotTest-797281576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:13 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6d6d20ce-2e2a-474e-9d26-9c39de53909e 1073741824 Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-524f515c-a07f-401b-bf60-604c984e3382 tempest-CreateVolumesFromSnapshotTest-797281576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-524f515c-a07f-401b-bf60-604c984e3382 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-524f515c-a07f-401b-bf60-604c984e3382 tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:13 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:13 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c62fc19-0865-4f91-8681-b2da0eeeb178]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c0633936-7e3e-4ab3-b7a2-cb885249b804 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab.0ce5fe40-805f-4b10-b3da-2f0bd2ad9633 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:14 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:25:14 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:14 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b28c377f-2627-401f-aa32-f123c54bbce9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "cinder-7c0ffc08-0722-40cd-823a-1f3218fdacad-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:14 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b28c377f-2627-401f-aa32-f123c54bbce9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "cinder-7c0ffc08-0722-40cd-823a-1f3218fdacad-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:14 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab.0ce5fe40-805f-4b10-b3da-2f0bd2ad9633 Jul 21 02:25:14 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:14 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b28c377f-2627-401f-aa32-f123c54bbce9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "cinder-quobyte-7c0ffc08-0722-40cd-823a-1f3218fdacad" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:14 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b28c377f-2627-401f-aa32-f123c54bbce9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "cinder-quobyte-7c0ffc08-0722-40cd-823a-1f3218fdacad" acquired by "delete_volume" :: waited 0.020s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:14 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cf791e-4db3-4d10-88cb-22c4f6b2e2f6]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b28c377f-2627-401f-aa32-f123c54bbce9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7c0ffc08-0722-40cd-823a-1f3218fdacad {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:14 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-524f515c-a07f-401b-bf60-604c984e3382 tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.309s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:14 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-524f515c-a07f-401b-bf60-604c984e3382 tempest-CreateVolumesFromSnapshotTest-797281576 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:25:14 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-524f515c-a07f-401b-bf60-604c984e3382 tempest-CreateVolumesFromSnapshotTest-797281576 None] Deleted volume successfully. Jul 21 02:25:14 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-524f515c-a07f-401b-bf60-604c984e3382 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "cinder-095f45a1-b8fa-48a6-99c0-a645c25d5300-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:14 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7c0ffc08-0722-40cd-823a-1f3218fdacad Jul 21 02:25:14 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:14 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c0633936-7e3e-4ab3-b7a2-cb885249b804 tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab.0ce5fe40-805f-4b10-b3da-2f0bd2ad9633" returned: 0 in 0.423s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-c0633936-7e3e-4ab3-b7a2-cb885249b804 tempest-ProjectMemberTests-723363327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:25:14 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6d6d20ce-2e2a-474e-9d26-9c39de53909e 1073741824" returned: 0 in 0.514s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:14 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a56d3f-4365-4c6b-9d01-02dbc2469e26]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c0633936-7e3e-4ab3-b7a2-cb885249b804 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6d6d20ce-2e2a-474e-9d26-9c39de53909e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:14 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6d6d20ce-2e2a-474e-9d26-9c39de53909e Jul 21 02:25:14 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:14 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab Jul 21 02:25:14 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:14 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b28c377f-2627-401f-aa32-f123c54bbce9 tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7c0ffc08-0722-40cd-823a-1f3218fdacad" returned: 0 in 0.425s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b28c377f-2627-401f-aa32-f123c54bbce9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7c0ffc08-0722-40cd-823a-1f3218fdacad {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:14 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7c0ffc08-0722-40cd-823a-1f3218fdacad Jul 21 02:25:14 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:14 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6d6d20ce-2e2a-474e-9d26-9c39de53909e" returned: 0 in 0.282s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:25:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:14 devstack cinder-volume[87566]: DEBUG cinder.volume.volume_utils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Attempting download of 49e9e10d-a816-4715-9939-4e40c07abad5 ((None, [{'url': 'file:///opt/stack/data/glance/images/49e9e10d-a816-4715-9939-4e40c07abad5', 'metadata': {}}])) to volume 6d6d20ce-2e2a-474e-9d26-9c39de53909e. {{(pid=87566) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 02:25:14 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c0633936-7e3e-4ab3-b7a2-cb885249b804 tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab" returned: 0 in 0.412s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c0633936-7e3e-4ab3-b7a2-cb885249b804 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab.0ce5fe40-805f-4b10-b3da-2f0bd2ad9633 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:14 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf56b8f-11a8-4c6c-83a2-c11c9cfa0570]: (4, 'raw') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49e9e10d-a816-4715-9939-4e40c07abad5_ktszcr51 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:14 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab.0ce5fe40-805f-4b10-b3da-2f0bd2ad9633 Jul 21 02:25:14 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:14 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b28c377f-2627-401f-aa32-f123c54bbce9 tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-7c0ffc08-0722-40cd-823a-1f3218fdacad" returned: 0 in 0.299s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b28c377f-2627-401f-aa32-f123c54bbce9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "cinder-quobyte-7c0ffc08-0722-40cd-823a-1f3218fdacad" released by "delete_volume" :: held 0.770s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:15 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49e9e10d-a816-4715-9939-4e40c07abad5_ktszcr51 Jul 21 02:25:15 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-b28c377f-2627-401f-aa32-f123c54bbce9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Created reservations ['6c114513-aeb3-47f8-9e0b-af6cd9d4c82a', '1f20e7e7-c2b1-4691-9a08-e3e3f3e74b74', 'd59fc29a-0fc8-48c5-9902-80b99e2a0d24', '636cbb47-5f17-426a-b2b3-3a7aeb743cbf'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-49c69a15-6cab-48f2-a4f4-66985a102fcf tempest-CinderUnicodeTest-429463113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-49c69a15-6cab-48f2-a4f4-66985a102fcf tempest-CinderUnicodeTest-429463113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-49c69a15-6cab-48f2-a4f4-66985a102fcf tempest-CinderUnicodeTest-429463113 None] Creating offline snapshot 29f11976-7968-4e35-94b0-be4fded60ec2 of volume b1b55550-86b1-46d4-91c8-1120220dedf3 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0983df2-c5db-42d2-81d3-4321e9fb8aa9]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-49c69a15-6cab-48f2-a4f4-66985a102fcf tempest-CinderUnicodeTest-429463113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b28c377f-2627-401f-aa32-f123c54bbce9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b28c377f-2627-401f-aa32-f123c54bbce9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b28c377f-2627-401f-aa32-f123c54bbce9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b28c377f-2627-401f-aa32-f123c54bbce9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b28c377f-2627-401f-aa32-f123c54bbce9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b28c377f-2627-401f-aa32-f123c54bbce9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:15 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:25:15 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:15 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49e9e10d-a816-4715-9939-4e40c07abad5_ktszcr51" returned: 0 in 0.403s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49e9e10d-a816-4715-9939-4e40c07abad5_ktszcr51 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ab6a4296-d7dc-4567-90c0-2a3279adb3d0 tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "cinder-dfd0e017-da35-4dcf-8c43-456b1785fd66-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ab6a4296-d7dc-4567-90c0-2a3279adb3d0 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "cinder-dfd0e017-da35-4dcf-8c43-456b1785fd66-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:15 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c0633936-7e3e-4ab3-b7a2-cb885249b804 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab.0ce5fe40-805f-4b10-b3da-2f0bd2ad9633" returned: 0 in 0.499s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c0633936-7e3e-4ab3-b7a2-cb885249b804 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab.0ce5fe40-805f-4b10-b3da-2f0bd2ad9633 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:15 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3 Jul 21 02:25:15 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:15 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab.0ce5fe40-805f-4b10-b3da-2f0bd2ad9633 Jul 21 02:25:15 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ab6a4296-d7dc-4567-90c0-2a3279adb3d0 tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "cinder-quobyte-dfd0e017-da35-4dcf-8c43-456b1785fd66" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ab6a4296-d7dc-4567-90c0-2a3279adb3d0 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "cinder-quobyte-dfd0e017-da35-4dcf-8c43-456b1785fd66" acquired by "delete_volume" :: waited 0.017s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:15 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49e9e10d-a816-4715-9939-4e40c07abad5_ktszcr51 Jul 21 02:25:15 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb88fc1c-0830-4f6c-af71-70fac0f6695d]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ab6a4296-d7dc-4567-90c0-2a3279adb3d0 tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-dfd0e017-da35-4dcf-8c43-456b1785fd66 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:15 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b28c377f-2627-401f-aa32-f123c54bbce9 tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.344s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-b28c377f-2627-401f-aa32-f123c54bbce9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:25:15 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-b28c377f-2627-401f-aa32-f123c54bbce9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Deleted volume successfully. Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b28c377f-2627-401f-aa32-f123c54bbce9 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "cinder-7c0ffc08-0722-40cd-823a-1f3218fdacad-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:15 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-dfd0e017-da35-4dcf-8c43-456b1785fd66 Jul 21 02:25:15 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:15 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49e9e10d-a816-4715-9939-4e40c07abad5_ktszcr51" returned: 1 in 0.412s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:15 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49e9e10d-a816-4715-9939-4e40c07abad5_ktszcr51' failed. Not Retrying. {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c0633936-7e3e-4ab3-b7a2-cb885249b804 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab.0ce5fe40-805f-4b10-b3da-2f0bd2ad9633" returned: 0 in 0.356s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[689ff598-f910-4562-a185-9ef1d7eaa010]: (4, 'raw') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49e9e10d-a816-4715-9939-4e40c07abad5_65va4scqdevstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:15 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-49c69a15-6cab-48f2-a4f4-66985a102fcf tempest-CinderUnicodeTest-429463113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3" returned: 0 in 0.612s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-49c69a15-6cab-48f2-a4f4-66985a102fcf tempest-CinderUnicodeTest-429463113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3.29f11976-7968-4e35-94b0-be4fded60ec2 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c0633936-7e3e-4ab3-b7a2-cb885249b804 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-0ce5fe40-805f-4b10-b3da-2f0bd2ad9633" released by "_delete_snapshot" :: held 1.864s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c0633936-7e3e-4ab3-b7a2-cb885249b804 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab" released by "delete_snapshot" :: held 1.934s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:15 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3.29f11976-7968-4e35-94b0-be4fded60ec2 1G Jul 21 02:25:15 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:15 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49e9e10d-a816-4715-9939-4e40c07abad5_65va4scqdevstack@QuobyteHD Jul 21 02:25:15 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-c0633936-7e3e-4ab3-b7a2-cb885249b804 tempest-ProjectMemberTests-723363327 None] Created reservations ['6659bcfc-bcc4-45d3-ba58-7a30ec374d1d', 'ace41a3a-ed6d-4525-9117-53d3d1cca1ca', '1aca40ec-d48f-42b1-a425-1654002b5afb', 'c06598d8-f09e-421d-b2c1-c2ee72a5e97b'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:15 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-c0633936-7e3e-4ab3-b7a2-cb885249b804 tempest-ProjectMemberTests-723363327 None] Delete snapshot completed successfully. Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c0633936-7e3e-4ab3-b7a2-cb885249b804 tempest-ProjectMemberTests-723363327 None] Lock "cinder-0ce5fe40-805f-4b10-b3da-2f0bd2ad9633-delete_snapshot" released by "delete_snapshot" :: held 2.106s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:15 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ab6a4296-d7dc-4567-90c0-2a3279adb3d0 tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-dfd0e017-da35-4dcf-8c43-456b1785fd66" returned: 0 in 0.500s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ab6a4296-d7dc-4567-90c0-2a3279adb3d0 tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-dfd0e017-da35-4dcf-8c43-456b1785fd66 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:16 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-dfd0e017-da35-4dcf-8c43-456b1785fd66 Jul 21 02:25:16 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e3b4596e-3869-4c08-8b3a-61737e1251c8 tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:16 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49e9e10d-a816-4715-9939-4e40c07abad5_65va4scqdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49e9e10d-a816-4715-9939-4e40c07abad5_65va4scqdevstack@QuobyteHD {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e3b4596e-3869-4c08-8b3a-61737e1251c8 tempest-ProjectMemberTests-723363327 None] Lock "cinder-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e3b4596e-3869-4c08-8b3a-61737e1251c8 tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-quobyte-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e3b4596e-3869-4c08-8b3a-61737e1251c8 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab" acquired by "delete_volume" :: waited 0.033s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e07b9e-314c-4977-a619-1a0448e1731c]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e3b4596e-3869-4c08-8b3a-61737e1251c8 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:16 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49e9e10d-a816-4715-9939-4e40c07abad5_65va4scqdevstack@QuobyteHD Jul 21 02:25:16 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:16 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ab6a4296-d7dc-4567-90c0-2a3279adb3d0 tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-dfd0e017-da35-4dcf-8c43-456b1785fd66" returned: 0 in 0.331s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ab6a4296-d7dc-4567-90c0-2a3279adb3d0 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "cinder-quobyte-dfd0e017-da35-4dcf-8c43-456b1785fd66" released by "delete_volume" :: held 0.879s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:16 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab Jul 21 02:25:16 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-ab6a4296-d7dc-4567-90c0-2a3279adb3d0 tempest-CreateVolumesFromSnapshotTest-797281576 None] Created reservations ['ffc0cdf7-46c0-474d-8bfa-591e30b2a88f', '52c146a7-7a46-4d91-b80e-94e2688a9cdf', '8ba5304c-719b-41b8-939a-bd418bf401df', 'f98f7193-5fd1-4b8c-ae86-39fc9f678828'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:16 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-49c69a15-6cab-48f2-a4f4-66985a102fcf tempest-CinderUnicodeTest-429463113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3.29f11976-7968-4e35-94b0-be4fded60ec2 1G" returned: 0 in 0.592s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-49c69a15-6cab-48f2-a4f4-66985a102fcf tempest-CinderUnicodeTest-429463113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1b55550-86b1-46d4-91c8-1120220dedf3 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3.29f11976-7968-4e35-94b0-be4fded60ec2 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:16 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1b55550-86b1-46d4-91c8-1120220dedf3 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3.29f11976-7968-4e35-94b0-be4fded60ec2 Jul 21 02:25:16 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ab6a4296-d7dc-4567-90c0-2a3279adb3d0 tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ab6a4296-d7dc-4567-90c0-2a3279adb3d0 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ab6a4296-d7dc-4567-90c0-2a3279adb3d0 tempest-CreateVolumesFromSnapshotTest-797281576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ab6a4296-d7dc-4567-90c0-2a3279adb3d0 tempest-CreateVolumesFromSnapshotTest-797281576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ab6a4296-d7dc-4567-90c0-2a3279adb3d0 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ab6a4296-d7dc-4567-90c0-2a3279adb3d0 tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:16 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:25:16 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:16 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49e9e10d-a816-4715-9939-4e40c07abad5_65va4scqdevstack@QuobyteHD" returned: 1 in 0.475s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49e9e10d-a816-4715-9939-4e40c07abad5_65va4scqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] 49e9e10d-a816-4715-9939-4e40c07abad5 was raw, converting to qcow2 {{(pid=87566) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_49e9e10d-a816-4715-9939-4e40c07abad5_65va4scqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6d6d20ce-2e2a-474e-9d26-9c39de53909e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:16 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_49e9e10d-a816-4715-9939-4e40c07abad5_65va4scqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6d6d20ce-2e2a-474e-9d26-9c39de53909e Jul 21 02:25:16 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-56399ddd-1035-4fa7-8d98-75db744d0694 tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "cinder-cc6cbb77-238f-4e91-8986-5b857029d166-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-56399ddd-1035-4fa7-8d98-75db744d0694 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "cinder-cc6cbb77-238f-4e91-8986-5b857029d166-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:16 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-56399ddd-1035-4fa7-8d98-75db744d0694 tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "cinder-quobyte-cc6cbb77-238f-4e91-8986-5b857029d166" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e3b4596e-3869-4c08-8b3a-61737e1251c8 tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab" returned: 0 in 0.491s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e3b4596e-3869-4c08-8b3a-61737e1251c8 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-56399ddd-1035-4fa7-8d98-75db744d0694 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "cinder-quobyte-cc6cbb77-238f-4e91-8986-5b857029d166" acquired by "delete_volume" :: waited 0.042s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:16 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab Jul 21 02:25:16 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:16 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-49c69a15-6cab-48f2-a4f4-66985a102fcf tempest-CinderUnicodeTest-429463113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1b55550-86b1-46d4-91c8-1120220dedf3 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3.29f11976-7968-4e35-94b0-be4fded60ec2" returned: 0 in 0.392s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:16 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-49c69a15-6cab-48f2-a4f4-66985a102fcf tempest-CinderUnicodeTest-429463113 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3.29f11976-7968-4e35-94b0-be4fded60ec2 is being set with open permissions: ugo+rw Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-49c69a15-6cab-48f2-a4f4-66985a102fcf tempest-CinderUnicodeTest-429463113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3.29f11976-7968-4e35-94b0-be4fded60ec2 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc72ad5-c73e-4e49-b78a-1409a5bf6347]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-56399ddd-1035-4fa7-8d98-75db744d0694 tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cc6cbb77-238f-4e91-8986-5b857029d166 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:16 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3.29f11976-7968-4e35-94b0-be4fded60ec2 Jul 21 02:25:16 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:16 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ab6a4296-d7dc-4567-90c0-2a3279adb3d0 tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.367s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-ab6a4296-d7dc-4567-90c0-2a3279adb3d0 tempest-CreateVolumesFromSnapshotTest-797281576 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:25:16 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-ab6a4296-d7dc-4567-90c0-2a3279adb3d0 tempest-CreateVolumesFromSnapshotTest-797281576 None] Deleted volume successfully. Jul 21 02:25:16 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ab6a4296-d7dc-4567-90c0-2a3279adb3d0 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "cinder-dfd0e017-da35-4dcf-8c43-456b1785fd66-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:16 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cc6cbb77-238f-4e91-8986-5b857029d166 Jul 21 02:25:16 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:17 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e3b4596e-3869-4c08-8b3a-61737e1251c8 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab" returned: 0 in 0.335s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e3b4596e-3869-4c08-8b3a-61737e1251c8 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab" released by "delete_volume" :: held 0.890s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:17 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-49c69a15-6cab-48f2-a4f4-66985a102fcf tempest-CinderUnicodeTest-429463113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3.29f11976-7968-4e35-94b0-be4fded60ec2" returned: 0 in 0.308s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-e3b4596e-3869-4c08-8b3a-61737e1251c8 tempest-ProjectMemberTests-723363327 None] Created reservations ['488fb78e-8ddb-4eb6-8284-47a93785ff2b', '6ae8a759-a17e-4926-a37e-3dc9e18c648b', '2b3bbc6d-6d10-49ae-a00e-1fa421db86cf', '42a1acd1-6ee2-415f-b4d3-64cb4de97a28'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:17 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-49c69a15-6cab-48f2-a4f4-66985a102fcf tempest-CinderUnicodeTest-429463113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_49e9e10d-a816-4715-9939-4e40c07abad5_65va4scqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6d6d20ce-2e2a-474e-9d26-9c39de53909e" returned: 0 in 0.607s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_49e9e10d-a816-4715-9939-4e40c07abad5_65va4scqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6d6d20ce-2e2a-474e-9d26-9c39de53909e {{(pid=87566) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 02:25:17 devstack cinder-volume[87566]: INFO cinder.image.image_utils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Converted 0.00 MB image at 0.00 MB/s Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6d6d20ce-2e2a-474e-9d26-9c39de53909e 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:17 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3.info Jul 21 02:25:17 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:17 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6d6d20ce-2e2a-474e-9d26-9c39de53909e 1G Jul 21 02:25:17 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e3b4596e-3869-4c08-8b3a-61737e1251c8 tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e3b4596e-3869-4c08-8b3a-61737e1251c8 tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e3b4596e-3869-4c08-8b3a-61737e1251c8 tempest-ProjectMemberTests-723363327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e3b4596e-3869-4c08-8b3a-61737e1251c8 tempest-ProjectMemberTests-723363327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e3b4596e-3869-4c08-8b3a-61737e1251c8 tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e3b4596e-3869-4c08-8b3a-61737e1251c8 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:17 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:25:17 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:17 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-56399ddd-1035-4fa7-8d98-75db744d0694 tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cc6cbb77-238f-4e91-8986-5b857029d166" returned: 0 in 0.556s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-56399ddd-1035-4fa7-8d98-75db744d0694 tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cc6cbb77-238f-4e91-8986-5b857029d166 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:17 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cc6cbb77-238f-4e91-8986-5b857029d166 Jul 21 02:25:17 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:17 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-49c69a15-6cab-48f2-a4f4-66985a102fcf tempest-CinderUnicodeTest-429463113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3.info" returned: 0 in 0.423s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:17 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-49c69a15-6cab-48f2-a4f4-66985a102fcf tempest-CinderUnicodeTest-429463113 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3.info is being set with open permissions: ugo+rw Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-49c69a15-6cab-48f2-a4f4-66985a102fcf tempest-CinderUnicodeTest-429463113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:17 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3.info Jul 21 02:25:17 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:17 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e3b4596e-3869-4c08-8b3a-61737e1251c8 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.364s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-e3b4596e-3869-4c08-8b3a-61737e1251c8 tempest-ProjectMemberTests-723363327 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:25:17 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-e3b4596e-3869-4c08-8b3a-61737e1251c8 tempest-ProjectMemberTests-723363327 None] Deleted volume successfully. Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-e3b4596e-3869-4c08-8b3a-61737e1251c8 tempest-ProjectMemberTests-723363327 None] Lock "cinder-e0bd31d4-c1db-424e-bbe1-3ee3a7134aab-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:17 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6d6d20ce-2e2a-474e-9d26-9c39de53909e 1G" returned: 0 in 0.551s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG cinder.volume.volume_utils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Downloaded image 49e9e10d-a816-4715-9939-4e40c07abad5 ((None, [{'url': 'file:///opt/stack/data/glance/images/49e9e10d-a816-4715-9939-4e40c07abad5', 'metadata': {}}])) to volume 6d6d20ce-2e2a-474e-9d26-9c39de53909e successfully. {{(pid=87566) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Temporary image 49e9e10d-a816-4715-9939-4e40c07abad5 for user 3688282f91dd447eb7b9854790bddaeb is deleted. {{(pid=87566) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG cinder.volume.volume_utils [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Marking volume 6d6d20ce-2e2a-474e-9d26-9c39de53909e as bootable. {{(pid=87566) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Copying metadata from image 49e9e10d-a816-4715-9939-4e40c07abad5 to 6d6d20ce-2e2a-474e-9d26-9c39de53909e. {{(pid=87566) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Creating volume glance metadata for volume 6d6d20ce-2e2a-474e-9d26-9c39de53909e backed by image 49e9e10d-a816-4715-9939-4e40c07abad5 with: {'image_id': '49e9e10d-a816-4715-9939-4e40c07abad5', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '28fd3661a880f0f3463bd6349b41a432', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87566) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 02:25:17 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-56399ddd-1035-4fa7-8d98-75db744d0694 tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-cc6cbb77-238f-4e91-8986-5b857029d166" returned: 0 in 0.407s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-56399ddd-1035-4fa7-8d98-75db744d0694 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "cinder-quobyte-cc6cbb77-238f-4e91-8986-5b857029d166" released by "delete_volume" :: held 1.055s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (331e53c1-11c3-479e-b6a5-98425e3f5ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d6d20ce-2e2a-474e-9d26-9c39de53909e', 'volume_size': 1, 'image_id': '49e9e10d-a816-4715-9939-4e40c07abad5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49e9e10d-a816-4715-9939-4e40c07abad5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '28fd3661a880f0f3463bd6349b41a432', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2364396750f3417f9bff48481f82dd42', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bf32e302f8f5d11feda2cf269926b6a0601e6f1eb777d0ac52f68f7ee5d217c2ac45a5ea7d8cace23a7a8d2dc5093731e81914952e2b0317d7da050420e62039', 'id': '49e9e10d-a816-4715-9939-4e40c07abad5', 'created_at': datetime.datetime(2026, 7, 21, 0, 25, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 0, 25, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49e9e10d-a816-4715-9939-4e40c07abad5/file', 'properties': {}}, 'image_service': }' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a07c59cd-ba93-484c-9aa3-72d5b834aec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-56399ddd-1035-4fa7-8d98-75db744d0694 tempest-CreateVolumesFromSnapshotTest-797281576 None] Created reservations ['921a57b5-affb-423e-a14e-1ce3b18c5213', '8e2bf38c-02cd-41bf-8096-f529508ba912', '23b2e704-cc13-4e0e-9d49-1734d1018afb', '902cb477-95a8-4a05-b14b-997997542a7c'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:17 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Volume volume-6d6d20ce-2e2a-474e-9d26-9c39de53909e (6d6d20ce-2e2a-474e-9d26-9c39de53909e): created successfully Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a07c59cd-ba93-484c-9aa3-72d5b834aec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Flow 'volume_create_manager' (56953b4e-ae75-4802-af0d-e5bb3a6d2d7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:17 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-49c69a15-6cab-48f2-a4f4-66985a102fcf tempest-CinderUnicodeTest-429463113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3.info" returned: 0 in 0.370s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-49c69a15-6cab-48f2-a4f4-66985a102fcf tempest-CinderUnicodeTest-429463113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.813s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:18 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-97f1e109-122e-49a7-9d0b-1db12129583f tempest-VolumeImageDependencyTests-1519431039 None] Created volume successfully. Jul 21 02:25:18 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-49c69a15-6cab-48f2-a4f4-66985a102fcf tempest-CinderUnicodeTest-429463113 None] Create snapshot completed successfully Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] Flow 'volume_create_manager' (fc8e92b5-3851-4a6e-a5fb-9dce55699f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b413e1-8891-497c-8ff1-0c5a86074dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-56399ddd-1035-4fa7-8d98-75db744d0694 tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-56399ddd-1035-4fa7-8d98-75db744d0694 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-56399ddd-1035-4fa7-8d98-75db744d0694 tempest-CreateVolumesFromSnapshotTest-797281576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-56399ddd-1035-4fa7-8d98-75db744d0694 tempest-CreateVolumesFromSnapshotTest-797281576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-56399ddd-1035-4fa7-8d98-75db744d0694 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-56399ddd-1035-4fa7-8d98-75db744d0694 tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b413e1-8891-497c-8ff1-0c5a86074dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-300731274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=361d8e95-2a5a-451f-9ead-df18e756486d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9180fe803c342ad96c373b69434c36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:18Z,use_quota=True,user_id='33a1095c5e17461e8e8a710d76a95247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:18 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:25:18 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9727631-8221-4fb4-ab33-5f302349e29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9727631-8221-4fb4-ab33-5f302349e29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73a7dab9-2533-4ee0-9eb2-70a0295c8e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73a7dab9-2533-4ee0-9eb2-70a0295c8e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '361d8e95-2a5a-451f-9ead-df18e756486d', 'volume_name': 'volume-361d8e95-2a5a-451f-9ead-df18e756486d', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df88b027-6744-4586-99e9-bc9e0606d1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df88b027-6744-4586-99e9-bc9e0606d1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5aab57e-33c7-40d8-a3e8-7ff1a525cd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:18 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] Volume 361d8e95-2a5a-451f-9ead-df18e756486d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-361d8e95-2a5a-451f-9ead-df18e756486d', 'volume_size': 1} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-300731274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=361d8e95-2a5a-451f-9ead-df18e756486d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9180fe803c342ad96c373b69434c36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:18Z,use_quota=True,user_id='33a1095c5e17461e8e8a710d76a95247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] Creating volume 361d8e95-2a5a-451f-9ead-df18e756486d {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:25:18 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:18 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d 1073741824 Jul 21 02:25:18 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-02fcbdfe-61e4-4627-bc9f-fa7fdd82c5bf tempest-CinderUnicodeTest-429463113 None] Acquiring lock "cinder-29f11976-7968-4e35-94b0-be4fded60ec2-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-02fcbdfe-61e4-4627-bc9f-fa7fdd82c5bf tempest-CinderUnicodeTest-429463113 None] Lock "cinder-29f11976-7968-4e35-94b0-be4fded60ec2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-02fcbdfe-61e4-4627-bc9f-fa7fdd82c5bf tempest-CinderUnicodeTest-429463113 None] Acquiring lock "cinder-quobyte-b1b55550-86b1-46d4-91c8-1120220dedf3" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:18 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-02fcbdfe-61e4-4627-bc9f-fa7fdd82c5bf tempest-CinderUnicodeTest-429463113 None] Lock "cinder-quobyte-b1b55550-86b1-46d4-91c8-1120220dedf3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-02fcbdfe-61e4-4627-bc9f-fa7fdd82c5bf tempest-CinderUnicodeTest-429463113 None] Acquiring lock "cinder-quobyte-29f11976-7968-4e35-94b0-be4fded60ec2" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-56399ddd-1035-4fa7-8d98-75db744d0694 tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.264s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-56399ddd-1035-4fa7-8d98-75db744d0694 tempest-CreateVolumesFromSnapshotTest-797281576 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:25:18 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-56399ddd-1035-4fa7-8d98-75db744d0694 tempest-CreateVolumesFromSnapshotTest-797281576 None] Deleted volume successfully. Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-02fcbdfe-61e4-4627-bc9f-fa7fdd82c5bf tempest-CinderUnicodeTest-429463113 None] Lock "cinder-quobyte-29f11976-7968-4e35-94b0-be4fded60ec2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-02fcbdfe-61e4-4627-bc9f-fa7fdd82c5bf tempest-CinderUnicodeTest-429463113 None] Deleting offline snapshot 29f11976-7968-4e35-94b0-be4fded60ec2 of volume b1b55550-86b1-46d4-91c8-1120220dedf3 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-02fcbdfe-61e4-4627-bc9f-fa7fdd82c5bf tempest-CinderUnicodeTest-429463113 None] snapshot_file for this snap is: volume-b1b55550-86b1-46d4-91c8-1120220dedf3.29f11976-7968-4e35-94b0-be4fded60ec2 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e620487-8515-4011-86b9-f34fe943bb1a]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-02fcbdfe-61e4-4627-bc9f-fa7fdd82c5bf tempest-CinderUnicodeTest-429463113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3.29f11976-7968-4e35-94b0-be4fded60ec2 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-56399ddd-1035-4fa7-8d98-75db744d0694 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "cinder-cc6cbb77-238f-4e91-8986-5b857029d166-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9e631aac-fb9a-457c-9221-bcd0dc43da69 tempest-VolumeImageDependencyTests-1519431039 None] Acquiring lock "cinder-6d6d20ce-2e2a-474e-9d26-9c39de53909e-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:18 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3.29f11976-7968-4e35-94b0-be4fded60ec2 Jul 21 02:25:18 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9e631aac-fb9a-457c-9221-bcd0dc43da69 tempest-VolumeImageDependencyTests-1519431039 None] Lock "cinder-6d6d20ce-2e2a-474e-9d26-9c39de53909e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9e631aac-fb9a-457c-9221-bcd0dc43da69 tempest-VolumeImageDependencyTests-1519431039 None] Acquiring lock "cinder-quobyte-6d6d20ce-2e2a-474e-9d26-9c39de53909e" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9e631aac-fb9a-457c-9221-bcd0dc43da69 tempest-VolumeImageDependencyTests-1519431039 None] Lock "cinder-quobyte-6d6d20ce-2e2a-474e-9d26-9c39de53909e" acquired by "delete_volume" :: waited 0.014s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[294a5ec1-9c14-4c69-90bb-8ab2d2491efa]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9e631aac-fb9a-457c-9221-bcd0dc43da69 tempest-VolumeImageDependencyTests-1519431039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6d6d20ce-2e2a-474e-9d26-9c39de53909e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:18 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d 1073741824" returned: 0 in 0.546s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:18 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6d6d20ce-2e2a-474e-9d26-9c39de53909e Jul 21 02:25:18 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:18 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d Jul 21 02:25:18 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:18 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-02fcbdfe-61e4-4627-bc9f-fa7fdd82c5bf tempest-CinderUnicodeTest-429463113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3.29f11976-7968-4e35-94b0-be4fded60ec2" returned: 0 in 0.429s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-02fcbdfe-61e4-4627-bc9f-fa7fdd82c5bf tempest-CinderUnicodeTest-429463113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1b55550-86b1-46d4-91c8-1120220dedf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f98cefc-0442-4c22-b45b-319d8fefb0a7]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-02fcbdfe-61e4-4627-bc9f-fa7fdd82c5bf tempest-CinderUnicodeTest-429463113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-053b5295-dd12-4886-bec1-b3c7d58a04b6 tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "cinder-89f4b894-07bc-43ef-8449-91a06c16cf9f-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-053b5295-dd12-4886-bec1-b3c7d58a04b6 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "cinder-89f4b894-07bc-43ef-8449-91a06c16cf9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-053b5295-dd12-4886-bec1-b3c7d58a04b6 tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "cinder-quobyte-ff872f22-8d12-4d9f-aed6-f1810e434c6f" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-053b5295-dd12-4886-bec1-b3c7d58a04b6 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "cinder-quobyte-ff872f22-8d12-4d9f-aed6-f1810e434c6f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-053b5295-dd12-4886-bec1-b3c7d58a04b6 tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "cinder-quobyte-89f4b894-07bc-43ef-8449-91a06c16cf9f" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-053b5295-dd12-4886-bec1-b3c7d58a04b6 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "cinder-quobyte-89f4b894-07bc-43ef-8449-91a06c16cf9f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-053b5295-dd12-4886-bec1-b3c7d58a04b6 tempest-CreateVolumesFromSnapshotTest-797281576 None] Deleting offline snapshot 89f4b894-07bc-43ef-8449-91a06c16cf9f of volume ff872f22-8d12-4d9f-aed6-f1810e434c6f {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:25:19 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:19 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3 Jul 21 02:25:19 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-053b5295-dd12-4886-bec1-b3c7d58a04b6 tempest-CreateVolumesFromSnapshotTest-797281576 None] snapshot_file for this snap is: volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f.89f4b894-07bc-43ef-8449-91a06c16cf9f {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d" returned: 0 in 0.317s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:19 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9e631aac-fb9a-457c-9221-bcd0dc43da69 tempest-VolumeImageDependencyTests-1519431039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6d6d20ce-2e2a-474e-9d26-9c39de53909e" returned: 0 in 0.426s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9e631aac-fb9a-457c-9221-bcd0dc43da69 tempest-VolumeImageDependencyTests-1519431039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6d6d20ce-2e2a-474e-9d26-9c39de53909e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e4b749-672b-446a-9cfc-054d02738da0]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-053b5295-dd12-4886-bec1-b3c7d58a04b6 tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f.89f4b894-07bc-43ef-8449-91a06c16cf9f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:19 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6d6d20ce-2e2a-474e-9d26-9c39de53909e Jul 21 02:25:19 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5aab57e-33c7-40d8-a3e8-7ff1a525cd37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-361d8e95-2a5a-451f-9ead-df18e756486d', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (040c1d9b-1365-46f8-ae96-7e0048cdf4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:19 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] Volume volume-361d8e95-2a5a-451f-9ead-df18e756486d (361d8e95-2a5a-451f-9ead-df18e756486d): created successfully Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (040c1d9b-1365-46f8-ae96-7e0048cdf4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] Flow 'volume_create_manager' (fc8e92b5-3851-4a6e-a5fb-9dce55699f4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:19 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-75ef21e6-8895-4125-8fbc-f36578372405 tempest-ProjectMemberTests-723363327 None] Created volume successfully. Jul 21 02:25:19 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f.89f4b894-07bc-43ef-8449-91a06c16cf9f Jul 21 02:25:19 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:19 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-02fcbdfe-61e4-4627-bc9f-fa7fdd82c5bf tempest-CinderUnicodeTest-429463113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3" returned: 0 in 0.434s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-02fcbdfe-61e4-4627-bc9f-fa7fdd82c5bf tempest-CinderUnicodeTest-429463113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3.29f11976-7968-4e35-94b0-be4fded60ec2 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:19 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9e631aac-fb9a-457c-9221-bcd0dc43da69 tempest-VolumeImageDependencyTests-1519431039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6d6d20ce-2e2a-474e-9d26-9c39de53909e" returned: 0 in 0.283s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9e631aac-fb9a-457c-9221-bcd0dc43da69 tempest-VolumeImageDependencyTests-1519431039 None] Lock "cinder-quobyte-6d6d20ce-2e2a-474e-9d26-9c39de53909e" released by "delete_volume" :: held 0.753s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:19 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3.29f11976-7968-4e35-94b0-be4fded60ec2 Jul 21 02:25:19 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-9e631aac-fb9a-457c-9221-bcd0dc43da69 tempest-VolumeImageDependencyTests-1519431039 None] Created reservations ['6ab4fe95-8674-4f12-9016-18dfb77e7286', 'bc193ccb-07f3-4665-adf3-42d7064f8894', '5e5663c6-6649-4ec5-b402-09903ae797d1', 'f07ab55f-bd3e-40cd-bb4d-d5f052820b09'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9e631aac-fb9a-457c-9221-bcd0dc43da69 tempest-VolumeImageDependencyTests-1519431039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9e631aac-fb9a-457c-9221-bcd0dc43da69 tempest-VolumeImageDependencyTests-1519431039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9e631aac-fb9a-457c-9221-bcd0dc43da69 tempest-VolumeImageDependencyTests-1519431039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9e631aac-fb9a-457c-9221-bcd0dc43da69 tempest-VolumeImageDependencyTests-1519431039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9e631aac-fb9a-457c-9221-bcd0dc43da69 tempest-VolumeImageDependencyTests-1519431039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9e631aac-fb9a-457c-9221-bcd0dc43da69 tempest-VolumeImageDependencyTests-1519431039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:19 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-053b5295-dd12-4886-bec1-b3c7d58a04b6 tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f.89f4b894-07bc-43ef-8449-91a06c16cf9f" returned: 0 in 0.422s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-053b5295-dd12-4886-bec1-b3c7d58a04b6 tempest-CreateVolumesFromSnapshotTest-797281576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:25:19 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:25:19 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[641abbb8-4292-454f-aa05-3dd379e3a4dc]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-053b5295-dd12-4886-bec1-b3c7d58a04b6 tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:19 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f Jul 21 02:25:19 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:19 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-02fcbdfe-61e4-4627-bc9f-fa7fdd82c5bf tempest-CinderUnicodeTest-429463113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3.29f11976-7968-4e35-94b0-be4fded60ec2" returned: 0 in 0.369s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-02fcbdfe-61e4-4627-bc9f-fa7fdd82c5bf tempest-CinderUnicodeTest-429463113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3.29f11976-7968-4e35-94b0-be4fded60ec2 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:19 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3.29f11976-7968-4e35-94b0-be4fded60ec2 Jul 21 02:25:19 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:19 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9e631aac-fb9a-457c-9221-bcd0dc43da69 tempest-VolumeImageDependencyTests-1519431039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.308s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-9e631aac-fb9a-457c-9221-bcd0dc43da69 tempest-VolumeImageDependencyTests-1519431039 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:25:19 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-9e631aac-fb9a-457c-9221-bcd0dc43da69 tempest-VolumeImageDependencyTests-1519431039 None] Deleted volume successfully. Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-9e631aac-fb9a-457c-9221-bcd0dc43da69 tempest-VolumeImageDependencyTests-1519431039 None] Lock "cinder-6d6d20ce-2e2a-474e-9d26-9c39de53909e-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:19 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-053b5295-dd12-4886-bec1-b3c7d58a04b6 tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f" returned: 0 in 0.410s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-053b5295-dd12-4886-bec1-b3c7d58a04b6 tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f.89f4b894-07bc-43ef-8449-91a06c16cf9f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:19 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f.89f4b894-07bc-43ef-8449-91a06c16cf9f Jul 21 02:25:19 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:20 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-02fcbdfe-61e4-4627-bc9f-fa7fdd82c5bf tempest-CinderUnicodeTest-429463113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3.29f11976-7968-4e35-94b0-be4fded60ec2" returned: 0 in 0.338s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-02fcbdfe-61e4-4627-bc9f-fa7fdd82c5bf tempest-CinderUnicodeTest-429463113 None] Lock "cinder-quobyte-29f11976-7968-4e35-94b0-be4fded60ec2" released by "_delete_snapshot" :: held 1.736s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-02fcbdfe-61e4-4627-bc9f-fa7fdd82c5bf tempest-CinderUnicodeTest-429463113 None] Lock "cinder-quobyte-b1b55550-86b1-46d4-91c8-1120220dedf3" released by "delete_snapshot" :: held 1.764s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:20 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-02fcbdfe-61e4-4627-bc9f-fa7fdd82c5bf tempest-CinderUnicodeTest-429463113 None] Created reservations ['46d25ded-de90-426f-98e1-07ae012448d8', 'f41fa2ed-7a19-46fe-8416-09548cd773ac', '250ea5a0-b402-4311-be25-b78ddf18f3cf', 'd5f8d2ad-1b4d-4efc-9e09-4a4eacfa793b'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b941a734-0f03-4aa6-9b9a-4e26a4bed04f tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b941a734-0f03-4aa6-9b9a-4e26a4bed04f tempest-ProjectMemberTests-723363327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:20 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-b941a734-0f03-4aa6-9b9a-4e26a4bed04f tempest-ProjectMemberTests-723363327 None] Creating offline snapshot 1027b8b1-7b09-4d46-9698-beaa5f455054 of volume 361d8e95-2a5a-451f-9ead-df18e756486d {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:25:20 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-02fcbdfe-61e4-4627-bc9f-fa7fdd82c5bf tempest-CinderUnicodeTest-429463113 None] Delete snapshot completed successfully. Jul 21 02:25:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-02fcbdfe-61e4-4627-bc9f-fa7fdd82c5bf tempest-CinderUnicodeTest-429463113 None] Lock "cinder-29f11976-7968-4e35-94b0-be4fded60ec2-delete_snapshot" released by "delete_snapshot" :: held 1.990s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:20 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[31747de0-1f1a-42b1-8264-9345f6bed963]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b941a734-0f03-4aa6-9b9a-4e26a4bed04f tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:20 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-053b5295-dd12-4886-bec1-b3c7d58a04b6 tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f.89f4b894-07bc-43ef-8449-91a06c16cf9f" returned: 0 in 0.475s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-053b5295-dd12-4886-bec1-b3c7d58a04b6 tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f.89f4b894-07bc-43ef-8449-91a06c16cf9f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:20 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d Jul 21 02:25:20 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:20 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f.89f4b894-07bc-43ef-8449-91a06c16cf9f Jul 21 02:25:20 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ce4c162d-2368-4ce4-b092-2312e8f9a242 tempest-CinderUnicodeTest-429463113 None] Acquiring lock "cinder-b1b55550-86b1-46d4-91c8-1120220dedf3-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ce4c162d-2368-4ce4-b092-2312e8f9a242 tempest-CinderUnicodeTest-429463113 None] Lock "cinder-b1b55550-86b1-46d4-91c8-1120220dedf3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ce4c162d-2368-4ce4-b092-2312e8f9a242 tempest-CinderUnicodeTest-429463113 None] Acquiring lock "cinder-quobyte-b1b55550-86b1-46d4-91c8-1120220dedf3" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ce4c162d-2368-4ce4-b092-2312e8f9a242 tempest-CinderUnicodeTest-429463113 None] Lock "cinder-quobyte-b1b55550-86b1-46d4-91c8-1120220dedf3" acquired by "delete_volume" :: waited 0.019s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:20 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3f0cf6-f476-473f-aba8-5a4307f63f37]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ce4c162d-2368-4ce4-b092-2312e8f9a242 tempest-CinderUnicodeTest-429463113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:20 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-053b5295-dd12-4886-bec1-b3c7d58a04b6 tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f.89f4b894-07bc-43ef-8449-91a06c16cf9f" returned: 0 in 0.344s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:20 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3 Jul 21 02:25:20 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:20 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b941a734-0f03-4aa6-9b9a-4e26a4bed04f tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d" returned: 0 in 0.514s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b941a734-0f03-4aa6-9b9a-4e26a4bed04f tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d.1027b8b1-7b09-4d46-9698-beaa5f455054 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-053b5295-dd12-4886-bec1-b3c7d58a04b6 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "cinder-quobyte-89f4b894-07bc-43ef-8449-91a06c16cf9f" released by "_delete_snapshot" :: held 1.836s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:20 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-053b5295-dd12-4886-bec1-b3c7d58a04b6 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "cinder-quobyte-ff872f22-8d12-4d9f-aed6-f1810e434c6f" released by "delete_snapshot" :: held 1.872s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:20 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d.1027b8b1-7b09-4d46-9698-beaa5f455054 1G Jul 21 02:25:20 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:20 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-053b5295-dd12-4886-bec1-b3c7d58a04b6 tempest-CreateVolumesFromSnapshotTest-797281576 None] Created reservations ['ddb56ba2-89e1-4905-9f76-603accc56760', '65f9372b-b268-4265-b0f5-3f202ee299f1', 'f4f84a90-3931-421c-a85b-8b7a3d2d2ce9', 'f37493f1-2163-4118-a4f3-75f4e6ffc7d4'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:21 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-053b5295-dd12-4886-bec1-b3c7d58a04b6 tempest-CreateVolumesFromSnapshotTest-797281576 None] Delete snapshot completed successfully. Jul 21 02:25:21 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-053b5295-dd12-4886-bec1-b3c7d58a04b6 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "cinder-89f4b894-07bc-43ef-8449-91a06c16cf9f-delete_snapshot" released by "delete_snapshot" :: held 2.049s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:21 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ce4c162d-2368-4ce4-b092-2312e8f9a242 tempest-CinderUnicodeTest-429463113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3" returned: 0 in 0.523s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ce4c162d-2368-4ce4-b092-2312e8f9a242 tempest-CinderUnicodeTest-429463113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:21 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-284f983e-5c5b-48d1-a3cc-29d222e80078 tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "cinder-ff872f22-8d12-4d9f-aed6-f1810e434c6f-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:21 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3 Jul 21 02:25:21 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:21 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-284f983e-5c5b-48d1-a3cc-29d222e80078 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "cinder-ff872f22-8d12-4d9f-aed6-f1810e434c6f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:21 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-284f983e-5c5b-48d1-a3cc-29d222e80078 tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "cinder-quobyte-ff872f22-8d12-4d9f-aed6-f1810e434c6f" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:21 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-284f983e-5c5b-48d1-a3cc-29d222e80078 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "cinder-quobyte-ff872f22-8d12-4d9f-aed6-f1810e434c6f" acquired by "delete_volume" :: waited 0.017s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:21 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[e384a94b-437d-4246-9cd2-4249294ab721]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-284f983e-5c5b-48d1-a3cc-29d222e80078 tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:21 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b941a734-0f03-4aa6-9b9a-4e26a4bed04f tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d.1027b8b1-7b09-4d46-9698-beaa5f455054 1G" returned: 0 in 0.635s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b941a734-0f03-4aa6-9b9a-4e26a4bed04f tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-361d8e95-2a5a-451f-9ead-df18e756486d -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d.1027b8b1-7b09-4d46-9698-beaa5f455054 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:21 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f Jul 21 02:25:21 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:21 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-361d8e95-2a5a-451f-9ead-df18e756486d -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d.1027b8b1-7b09-4d46-9698-beaa5f455054 Jul 21 02:25:21 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:21 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ce4c162d-2368-4ce4-b092-2312e8f9a242 tempest-CinderUnicodeTest-429463113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b1b55550-86b1-46d4-91c8-1120220dedf3" returned: 0 in 0.368s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:21 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ce4c162d-2368-4ce4-b092-2312e8f9a242 tempest-CinderUnicodeTest-429463113 None] Lock "cinder-quobyte-b1b55550-86b1-46d4-91c8-1120220dedf3" released by "delete_volume" :: held 0.987s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:21 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-ce4c162d-2368-4ce4-b092-2312e8f9a242 tempest-CinderUnicodeTest-429463113 None] Created reservations ['07c0b88d-078b-4df4-b985-7c53a587f9e0', '872cf8f1-874d-4ed7-a172-1abbf7285b9f', 'fc1cd758-5f45-469f-a80e-4c8d56cd8391', 'a150b728-e556-4c94-8f93-5c1c62e3467f'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ce4c162d-2368-4ce4-b092-2312e8f9a242 tempest-CinderUnicodeTest-429463113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ce4c162d-2368-4ce4-b092-2312e8f9a242 tempest-CinderUnicodeTest-429463113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:21 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ce4c162d-2368-4ce4-b092-2312e8f9a242 tempest-CinderUnicodeTest-429463113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:21 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ce4c162d-2368-4ce4-b092-2312e8f9a242 tempest-CinderUnicodeTest-429463113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ce4c162d-2368-4ce4-b092-2312e8f9a242 tempest-CinderUnicodeTest-429463113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ce4c162d-2368-4ce4-b092-2312e8f9a242 tempest-CinderUnicodeTest-429463113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:21 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:25:21 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:21 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:21 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b941a734-0f03-4aa6-9b9a-4e26a4bed04f tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-361d8e95-2a5a-451f-9ead-df18e756486d -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d.1027b8b1-7b09-4d46-9698-beaa5f455054" returned: 0 in 0.380s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:21 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-b941a734-0f03-4aa6-9b9a-4e26a4bed04f tempest-ProjectMemberTests-723363327 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d.1027b8b1-7b09-4d46-9698-beaa5f455054 is being set with open permissions: ugo+rw Jul 21 02:25:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b941a734-0f03-4aa6-9b9a-4e26a4bed04f tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d.1027b8b1-7b09-4d46-9698-beaa5f455054 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-284f983e-5c5b-48d1-a3cc-29d222e80078 tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f" returned: 0 in 0.505s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-284f983e-5c5b-48d1-a3cc-29d222e80078 tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:21 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d.1027b8b1-7b09-4d46-9698-beaa5f455054 Jul 21 02:25:21 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:21 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f Jul 21 02:25:21 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:22 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ce4c162d-2368-4ce4-b092-2312e8f9a242 tempest-CinderUnicodeTest-429463113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.308s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:22 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-ce4c162d-2368-4ce4-b092-2312e8f9a242 tempest-CinderUnicodeTest-429463113 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:25:22 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-ce4c162d-2368-4ce4-b092-2312e8f9a242 tempest-CinderUnicodeTest-429463113 None] Deleted volume successfully. Jul 21 02:25:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ce4c162d-2368-4ce4-b092-2312e8f9a242 tempest-CinderUnicodeTest-429463113 None] Lock "cinder-b1b55550-86b1-46d4-91c8-1120220dedf3-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:22 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b941a734-0f03-4aa6-9b9a-4e26a4bed04f tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d.1027b8b1-7b09-4d46-9698-beaa5f455054" returned: 0 in 0.288s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:22 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-284f983e-5c5b-48d1-a3cc-29d222e80078 tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ff872f22-8d12-4d9f-aed6-f1810e434c6f" returned: 0 in 0.279s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-284f983e-5c5b-48d1-a3cc-29d222e80078 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "cinder-quobyte-ff872f22-8d12-4d9f-aed6-f1810e434c6f" released by "delete_volume" :: held 0.870s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b941a734-0f03-4aa6-9b9a-4e26a4bed04f tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:22 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d.info Jul 21 02:25:22 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:22 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-284f983e-5c5b-48d1-a3cc-29d222e80078 tempest-CreateVolumesFromSnapshotTest-797281576 None] Created reservations ['96e1c06e-72a2-49e3-b3cd-ef55f33bd1e2', '03cc4ae1-e8b6-4359-8283-2b286341ace9', '802cd91c-9dd9-44d9-a2f5-7708402a7473', '87dcca83-7f59-47e7-b46e-7ffc2225fdb4'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-284f983e-5c5b-48d1-a3cc-29d222e80078 tempest-CreateVolumesFromSnapshotTest-797281576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-284f983e-5c5b-48d1-a3cc-29d222e80078 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:22 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-284f983e-5c5b-48d1-a3cc-29d222e80078 tempest-CreateVolumesFromSnapshotTest-797281576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:22 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-284f983e-5c5b-48d1-a3cc-29d222e80078 tempest-CreateVolumesFromSnapshotTest-797281576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-284f983e-5c5b-48d1-a3cc-29d222e80078 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-284f983e-5c5b-48d1-a3cc-29d222e80078 tempest-CreateVolumesFromSnapshotTest-797281576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:22 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:25:22 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:22 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b941a734-0f03-4aa6-9b9a-4e26a4bed04f tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d.info" returned: 0 in 0.317s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:22 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-b941a734-0f03-4aa6-9b9a-4e26a4bed04f tempest-ProjectMemberTests-723363327 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d.info is being set with open permissions: ugo+rw Jul 21 02:25:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b941a734-0f03-4aa6-9b9a-4e26a4bed04f tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:22 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d.info Jul 21 02:25:22 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:22 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-284f983e-5c5b-48d1-a3cc-29d222e80078 tempest-CreateVolumesFromSnapshotTest-797281576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.317s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:22 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-284f983e-5c5b-48d1-a3cc-29d222e80078 tempest-CreateVolumesFromSnapshotTest-797281576 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:25:22 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-284f983e-5c5b-48d1-a3cc-29d222e80078 tempest-CreateVolumesFromSnapshotTest-797281576 None] Deleted volume successfully. Jul 21 02:25:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-284f983e-5c5b-48d1-a3cc-29d222e80078 tempest-CreateVolumesFromSnapshotTest-797281576 None] Lock "cinder-ff872f22-8d12-4d9f-aed6-f1810e434c6f-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:22 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b941a734-0f03-4aa6-9b9a-4e26a4bed04f tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d.info" returned: 0 in 0.322s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:22 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b941a734-0f03-4aa6-9b9a-4e26a4bed04f tempest-ProjectMemberTests-723363327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.583s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-55d36341-7d61-4988-b2b6-5716e57eac98 tempest-CinderUnicodeTest-429463113 None] Acquiring lock "cinder-fb482386-984e-455b-9d31-bf9d229f2c9f-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:22 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-55d36341-7d61-4988-b2b6-5716e57eac98 tempest-CinderUnicodeTest-429463113 None] Lock "cinder-fb482386-984e-455b-9d31-bf9d229f2c9f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:22 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-b941a734-0f03-4aa6-9b9a-4e26a4bed04f tempest-ProjectMemberTests-723363327 None] Create snapshot completed successfully Jul 21 02:25:23 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-55d36341-7d61-4988-b2b6-5716e57eac98 tempest-CinderUnicodeTest-429463113 None] Acquiring lock "cinder-quobyte-fb482386-984e-455b-9d31-bf9d229f2c9f" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:23 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-55d36341-7d61-4988-b2b6-5716e57eac98 tempest-CinderUnicodeTest-429463113 None] Lock "cinder-quobyte-fb482386-984e-455b-9d31-bf9d229f2c9f" acquired by "delete_volume" :: waited 0.029s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:23 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[523cce06-21a2-4a78-b698-9ede99932a39]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-55d36341-7d61-4988-b2b6-5716e57eac98 tempest-CinderUnicodeTest-429463113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fb482386-984e-455b-9d31-bf9d229f2c9f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:23 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fb482386-984e-455b-9d31-bf9d229f2c9f Jul 21 02:25:23 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:23 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8ab231c7-d237-4ebd-bd01-96db56a02a7a tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-1027b8b1-7b09-4d46-9698-beaa5f455054-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:23 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8ab231c7-d237-4ebd-bd01-96db56a02a7a tempest-ProjectMemberTests-723363327 None] Lock "cinder-1027b8b1-7b09-4d46-9698-beaa5f455054-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:23 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8ab231c7-d237-4ebd-bd01-96db56a02a7a tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-quobyte-361d8e95-2a5a-451f-9ead-df18e756486d" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:23 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8ab231c7-d237-4ebd-bd01-96db56a02a7a tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-361d8e95-2a5a-451f-9ead-df18e756486d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:23 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8ab231c7-d237-4ebd-bd01-96db56a02a7a tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-quobyte-1027b8b1-7b09-4d46-9698-beaa5f455054" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:23 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8ab231c7-d237-4ebd-bd01-96db56a02a7a tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-1027b8b1-7b09-4d46-9698-beaa5f455054" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:23 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-8ab231c7-d237-4ebd-bd01-96db56a02a7a tempest-ProjectMemberTests-723363327 None] Deleting offline snapshot 1027b8b1-7b09-4d46-9698-beaa5f455054 of volume 361d8e95-2a5a-451f-9ead-df18e756486d {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:25:23 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-8ab231c7-d237-4ebd-bd01-96db56a02a7a tempest-ProjectMemberTests-723363327 None] snapshot_file for this snap is: volume-361d8e95-2a5a-451f-9ead-df18e756486d.1027b8b1-7b09-4d46-9698-beaa5f455054 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:25:23 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-55d36341-7d61-4988-b2b6-5716e57eac98 tempest-CinderUnicodeTest-429463113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fb482386-984e-455b-9d31-bf9d229f2c9f" returned: 0 in 0.585s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-55d36341-7d61-4988-b2b6-5716e57eac98 tempest-CinderUnicodeTest-429463113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fb482386-984e-455b-9d31-bf9d229f2c9f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:23 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[174f556d-c5a3-45aa-b986-39f540662dcf]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:23 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8ab231c7-d237-4ebd-bd01-96db56a02a7a tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d.1027b8b1-7b09-4d46-9698-beaa5f455054 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:23 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fb482386-984e-455b-9d31-bf9d229f2c9f Jul 21 02:25:23 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:23 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d.1027b8b1-7b09-4d46-9698-beaa5f455054 Jul 21 02:25:23 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:24 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-55d36341-7d61-4988-b2b6-5716e57eac98 tempest-CinderUnicodeTest-429463113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fb482386-984e-455b-9d31-bf9d229f2c9f" returned: 0 in 0.373s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:24 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-55d36341-7d61-4988-b2b6-5716e57eac98 tempest-CinderUnicodeTest-429463113 None] Lock "cinder-quobyte-fb482386-984e-455b-9d31-bf9d229f2c9f" released by "delete_volume" :: held 1.031s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:24 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-55d36341-7d61-4988-b2b6-5716e57eac98 tempest-CinderUnicodeTest-429463113 None] Created reservations ['ede46d8a-1154-4760-9718-b31bd0559a6b', '8310ee78-37e1-4cfc-8ad2-b36d36abd24a', 'a26eae42-bc3a-4e07-a914-764442d1984a', 'e989d4ca-ff15-4f84-a3dd-49b67b454838'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-55d36341-7d61-4988-b2b6-5716e57eac98 tempest-CinderUnicodeTest-429463113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-55d36341-7d61-4988-b2b6-5716e57eac98 tempest-CinderUnicodeTest-429463113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:24 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-55d36341-7d61-4988-b2b6-5716e57eac98 tempest-CinderUnicodeTest-429463113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:24 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-55d36341-7d61-4988-b2b6-5716e57eac98 tempest-CinderUnicodeTest-429463113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-55d36341-7d61-4988-b2b6-5716e57eac98 tempest-CinderUnicodeTest-429463113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-55d36341-7d61-4988-b2b6-5716e57eac98 tempest-CinderUnicodeTest-429463113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:24 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8ab231c7-d237-4ebd-bd01-96db56a02a7a tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d.1027b8b1-7b09-4d46-9698-beaa5f455054" returned: 0 in 0.612s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:24 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-8ab231c7-d237-4ebd-bd01-96db56a02a7a tempest-ProjectMemberTests-723363327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-361d8e95-2a5a-451f-9ead-df18e756486d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:25:24 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:25:24 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:24 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[9480d228-d9a9-4e7f-96ee-1d952b04a78f]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8ab231c7-d237-4ebd-bd01-96db56a02a7a tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:24 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d Jul 21 02:25:24 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:24 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-55d36341-7d61-4988-b2b6-5716e57eac98 tempest-CinderUnicodeTest-429463113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.331s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:24 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-55d36341-7d61-4988-b2b6-5716e57eac98 tempest-CinderUnicodeTest-429463113 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:25:24 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-55d36341-7d61-4988-b2b6-5716e57eac98 tempest-CinderUnicodeTest-429463113 None] Deleted volume successfully. Jul 21 02:25:24 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-55d36341-7d61-4988-b2b6-5716e57eac98 tempest-CinderUnicodeTest-429463113 None] Lock "cinder-fb482386-984e-455b-9d31-bf9d229f2c9f-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:24 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8ab231c7-d237-4ebd-bd01-96db56a02a7a tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d" returned: 0 in 0.467s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8ab231c7-d237-4ebd-bd01-96db56a02a7a tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d.1027b8b1-7b09-4d46-9698-beaa5f455054 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:24 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d.1027b8b1-7b09-4d46-9698-beaa5f455054 Jul 21 02:25:24 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:24 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:25:24 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] Flow 'volume_create_manager' (8dd85ad3-1c34-45d9-b108-d6d8d3e0e275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:24 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ec5b6a-566b-424e-9eb4-387f85ca21ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:24 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ec5b6a-566b-424e-9eb4-387f85ca21ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-942423323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dcd4564-0eaf-4e19-ac26-19cbcdf65306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2b951dc489e4fb2beadcd7e6effef75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:25Z,use_quota=True,user_id='b415ece141044ee59134455fa2c42a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:24 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f89a26-dafc-4f9b-b6cb-524ca75b9016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:24 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f89a26-dafc-4f9b-b6cb-524ca75b9016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:24 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2010674b-e58a-482f-98cc-cc60b7447c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:24 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2010674b-e58a-482f-98cc-cc60b7447c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dcd4564-0eaf-4e19-ac26-19cbcdf65306', 'volume_name': 'volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:24 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (292f2140-25ac-4196-9a27-a8da94ae8f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:24 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (292f2140-25ac-4196-9a27-a8da94ae8f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:24 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69976a25-2e4c-4922-a70a-82ac2102bd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:24 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] Volume 1dcd4564-0eaf-4e19-ac26-19cbcdf65306: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306', 'volume_size': 1} Jul 21 02:25:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:24 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:25 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-942423323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dcd4564-0eaf-4e19-ac26-19cbcdf65306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2b951dc489e4fb2beadcd7e6effef75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:25Z,use_quota=True,user_id='b415ece141044ee59134455fa2c42a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:25:25 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] Creating volume 1dcd4564-0eaf-4e19-ac26-19cbcdf65306 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:25:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:25 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:25 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:25 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:25:25 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:25:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:25 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306 1073741824 Jul 21 02:25:25 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:25 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8ab231c7-d237-4ebd-bd01-96db56a02a7a tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d.1027b8b1-7b09-4d46-9698-beaa5f455054" returned: 0 in 0.399s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8ab231c7-d237-4ebd-bd01-96db56a02a7a tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d.1027b8b1-7b09-4d46-9698-beaa5f455054 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:25 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d.1027b8b1-7b09-4d46-9698-beaa5f455054 Jul 21 02:25:25 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:25 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8ab231c7-d237-4ebd-bd01-96db56a02a7a tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d.1027b8b1-7b09-4d46-9698-beaa5f455054" returned: 0 in 0.291s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:25 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306 1073741824" returned: 0 in 0.547s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:25 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8ab231c7-d237-4ebd-bd01-96db56a02a7a tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-1027b8b1-7b09-4d46-9698-beaa5f455054" released by "_delete_snapshot" :: held 2.002s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:25 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8ab231c7-d237-4ebd-bd01-96db56a02a7a tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-361d8e95-2a5a-451f-9ead-df18e756486d" released by "delete_snapshot" :: held 2.037s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:25 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306 Jul 21 02:25:25 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:25 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-8ab231c7-d237-4ebd-bd01-96db56a02a7a tempest-ProjectMemberTests-723363327 None] Created reservations ['b3362d78-5eb0-4692-8af2-d51039f28373', '121dde80-1f6c-4700-b84d-d0e5b4a2b595', '7eb0d7f7-a358-4295-82b9-45954716568a', 'ef48325e-8ae8-481c-b74e-a2d31016e008'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:25 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-8ab231c7-d237-4ebd-bd01-96db56a02a7a tempest-ProjectMemberTests-723363327 None] Delete snapshot completed successfully. Jul 21 02:25:25 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8ab231c7-d237-4ebd-bd01-96db56a02a7a tempest-ProjectMemberTests-723363327 None] Lock "cinder-1027b8b1-7b09-4d46-9698-beaa5f455054-delete_snapshot" released by "delete_snapshot" :: held 2.246s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:25 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306" returned: 0 in 0.281s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:25 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:25:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:25 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69976a25-2e4c-4922-a70a-82ac2102bd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:25 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d51cf1-9111-4a79-a356-af6b43c3c7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:25 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] Volume volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306 (1dcd4564-0eaf-4e19-ac26-19cbcdf65306): created successfully Jul 21 02:25:25 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d51cf1-9111-4a79-a356-af6b43c3c7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:25 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] Flow 'volume_create_manager' (8dd85ad3-1c34-45d9-b108-d6d8d3e0e275) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:25 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-7940fdc0-e192-41ff-a07e-fdca9f6c7287 tempest-ProjectReaderTests-1799797276 None] Created volume successfully. Jul 21 02:25:26 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-c56681ee-85fa-436f-a0de-db63132979ea tempest-ProjectAdminTests-779729427 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87566) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 21 02:25:26 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-df68d833-965b-4df5-b0f4-2d607fa1c99f tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-361d8e95-2a5a-451f-9ead-df18e756486d-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:26 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-df68d833-965b-4df5-b0f4-2d607fa1c99f tempest-ProjectMemberTests-723363327 None] Lock "cinder-361d8e95-2a5a-451f-9ead-df18e756486d-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:27 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-df68d833-965b-4df5-b0f4-2d607fa1c99f tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-quobyte-361d8e95-2a5a-451f-9ead-df18e756486d" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:27 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-df68d833-965b-4df5-b0f4-2d607fa1c99f tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-361d8e95-2a5a-451f-9ead-df18e756486d" acquired by "delete_volume" :: waited 0.038s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:27 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2baae0-d2b2-4def-ab26-6b4bcb93f6ad]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-df68d833-965b-4df5-b0f4-2d607fa1c99f tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:27 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d Jul 21 02:25:27 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-63800f8d-ea43-4903-8474-f4b06985c226 tempest-ProjectReaderTests-1799797276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-63800f8d-ea43-4903-8474-f4b06985c226 tempest-ProjectReaderTests-1799797276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:27 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-63800f8d-ea43-4903-8474-f4b06985c226 tempest-ProjectReaderTests-1799797276 None] Creating offline snapshot bbc87db0-5f4e-4026-b4f3-e8e1d5d49fc1 of volume 1dcd4564-0eaf-4e19-ac26-19cbcdf65306 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:25:27 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc13181-0605-4486-baae-55cb0987a4f1]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-63800f8d-ea43-4903-8474-f4b06985c226 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:27 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306 Jul 21 02:25:27 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:27 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-df68d833-965b-4df5-b0f4-2d607fa1c99f tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d" returned: 0 in 0.610s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-df68d833-965b-4df5-b0f4-2d607fa1c99f tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:27 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d Jul 21 02:25:27 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:27 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-63800f8d-ea43-4903-8474-f4b06985c226 tempest-ProjectReaderTests-1799797276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306" returned: 0 in 0.526s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-63800f8d-ea43-4903-8474-f4b06985c226 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306.bbc87db0-5f4e-4026-b4f3-e8e1d5d49fc1 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:27 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306.bbc87db0-5f4e-4026-b4f3-e8e1d5d49fc1 1G Jul 21 02:25:27 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:28 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-df68d833-965b-4df5-b0f4-2d607fa1c99f tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-361d8e95-2a5a-451f-9ead-df18e756486d" returned: 0 in 0.312s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:28 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-df68d833-965b-4df5-b0f4-2d607fa1c99f tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-361d8e95-2a5a-451f-9ead-df18e756486d" released by "delete_volume" :: held 1.017s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:28 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-df68d833-965b-4df5-b0f4-2d607fa1c99f tempest-ProjectMemberTests-723363327 None] Created reservations ['16db127c-6350-4f45-98fb-9977c0e74442', '44c19565-cbd7-4e09-a5ee-a7f4cc82c869', 'c3931a28-251c-4b45-a24c-0ce45ebdc3ad', '7f597b66-fefd-4da1-8826-836162e557de'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:28 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:UPDATE=312,cinder:SELECT=239,cinder:INSERT=89,cinder:DELETE=24 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:25:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-df68d833-965b-4df5-b0f4-2d607fa1c99f tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-df68d833-965b-4df5-b0f4-2d607fa1c99f tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:28 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-df68d833-965b-4df5-b0f4-2d607fa1c99f tempest-ProjectMemberTests-723363327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:28 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-df68d833-965b-4df5-b0f4-2d607fa1c99f tempest-ProjectMemberTests-723363327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-df68d833-965b-4df5-b0f4-2d607fa1c99f tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-df68d833-965b-4df5-b0f4-2d607fa1c99f tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:28 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:25:28 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:28 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-63800f8d-ea43-4903-8474-f4b06985c226 tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306.bbc87db0-5f4e-4026-b4f3-e8e1d5d49fc1 1G" returned: 0 in 0.544s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-63800f8d-ea43-4903-8474-f4b06985c226 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306.bbc87db0-5f4e-4026-b4f3-e8e1d5d49fc1 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:28 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306.bbc87db0-5f4e-4026-b4f3-e8e1d5d49fc1 Jul 21 02:25:28 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:28 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-df68d833-965b-4df5-b0f4-2d607fa1c99f tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.365s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:28 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-df68d833-965b-4df5-b0f4-2d607fa1c99f tempest-ProjectMemberTests-723363327 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:25:28 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-df68d833-965b-4df5-b0f4-2d607fa1c99f tempest-ProjectMemberTests-723363327 None] Deleted volume successfully. Jul 21 02:25:28 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=230,cinder:UPDATE=320,cinder:DELETE=32,cinder:INSERT=80 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:25:28 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-df68d833-965b-4df5-b0f4-2d607fa1c99f tempest-ProjectMemberTests-723363327 None] Lock "cinder-361d8e95-2a5a-451f-9ead-df18e756486d-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:28 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-63800f8d-ea43-4903-8474-f4b06985c226 tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306.bbc87db0-5f4e-4026-b4f3-e8e1d5d49fc1" returned: 0 in 0.340s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:28 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-63800f8d-ea43-4903-8474-f4b06985c226 tempest-ProjectReaderTests-1799797276 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306.bbc87db0-5f4e-4026-b4f3-e8e1d5d49fc1 is being set with open permissions: ugo+rw Jul 21 02:25:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-63800f8d-ea43-4903-8474-f4b06985c226 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306.bbc87db0-5f4e-4026-b4f3-e8e1d5d49fc1 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:28 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306.bbc87db0-5f4e-4026-b4f3-e8e1d5d49fc1 Jul 21 02:25:28 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:29 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-63800f8d-ea43-4903-8474-f4b06985c226 tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306.bbc87db0-5f4e-4026-b4f3-e8e1d5d49fc1" returned: 0 in 0.287s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-63800f8d-ea43-4903-8474-f4b06985c226 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:29 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306.info Jul 21 02:25:29 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:29 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-63800f8d-ea43-4903-8474-f4b06985c226 tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306.info" returned: 0 in 0.334s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:29 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-63800f8d-ea43-4903-8474-f4b06985c226 tempest-ProjectReaderTests-1799797276 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306.info is being set with open permissions: ugo+rw Jul 21 02:25:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-63800f8d-ea43-4903-8474-f4b06985c226 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:29 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306.info Jul 21 02:25:29 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:29 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-63800f8d-ea43-4903-8474-f4b06985c226 tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306.info" returned: 0 in 0.340s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-63800f8d-ea43-4903-8474-f4b06985c226 tempest-ProjectReaderTests-1799797276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.476s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:29 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:25:29 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] Flow 'volume_create_manager' (a657ad92-145a-4cbf-a493-43822f106eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:29 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1510f484-059b-4bf8-895c-79609a8f05d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:29 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-63800f8d-ea43-4903-8474-f4b06985c226 tempest-ProjectReaderTests-1799797276 None] Create snapshot completed successfully Jul 21 02:25:29 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1510f484-059b-4bf8-895c-79609a8f05d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2071072478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe00f72c-c554-421b-9868-428b246897f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9180fe803c342ad96c373b69434c36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:30Z,use_quota=True,user_id='33a1095c5e17461e8e8a710d76a95247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:29 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731c2545-c2d9-4cb5-9a0a-f6eee38bba74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:29 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731c2545-c2d9-4cb5-9a0a-f6eee38bba74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:29 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50b8ba1b-f1ef-47a9-8119-da7e16455c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:29 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50b8ba1b-f1ef-47a9-8119-da7e16455c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe00f72c-c554-421b-9868-428b246897f5', 'volume_name': 'volume-fe00f72c-c554-421b-9868-428b246897f5', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:29 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b20e10-8d77-41e2-8d49-934ec5499004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:29 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b20e10-8d77-41e2-8d49-934ec5499004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:29 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18c435e3-b1c9-4a6c-a8c4-22554cc6b4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:29 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] Volume fe00f72c-c554-421b-9868-428b246897f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe00f72c-c554-421b-9868-428b246897f5', 'volume_size': 1} Jul 21 02:25:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:29 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2071072478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe00f72c-c554-421b-9868-428b246897f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9180fe803c342ad96c373b69434c36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:30Z,use_quota=True,user_id='33a1095c5e17461e8e8a710d76a95247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:25:29 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] Creating volume fe00f72c-c554-421b-9868-428b246897f5 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:25:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:29 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:29 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:29 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:25:29 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:25:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:29 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5 1073741824 Jul 21 02:25:29 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:30 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5 1073741824" returned: 0 in 0.495s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:30 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5 Jul 21 02:25:30 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:30 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5" returned: 0 in 0.253s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:30 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:25:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18c435e3-b1c9-4a6c-a8c4-22554cc6b4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe00f72c-c554-421b-9868-428b246897f5', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af2bf5fa-9eef-4fcd-8a11-e961b4faa04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-130ad32f-2b68-4f58-a1fd-8c0c09a5ac0f tempest-ProjectReaderTests-1799797276 None] Acquiring lock "cinder-bbc87db0-5f4e-4026-b4f3-e8e1d5d49fc1-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:30 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] Volume volume-fe00f72c-c554-421b-9868-428b246897f5 (fe00f72c-c554-421b-9868-428b246897f5): created successfully Jul 21 02:25:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af2bf5fa-9eef-4fcd-8a11-e961b4faa04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:30 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] Flow 'volume_create_manager' (a657ad92-145a-4cbf-a493-43822f106eec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-130ad32f-2b68-4f58-a1fd-8c0c09a5ac0f tempest-ProjectReaderTests-1799797276 None] Lock "cinder-bbc87db0-5f4e-4026-b4f3-e8e1d5d49fc1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-130ad32f-2b68-4f58-a1fd-8c0c09a5ac0f tempest-ProjectReaderTests-1799797276 None] Acquiring lock "cinder-quobyte-1dcd4564-0eaf-4e19-ac26-19cbcdf65306" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:30 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-ef61683f-820b-4745-a8e7-a8ceb64412a8 tempest-ProjectMemberTests-723363327 None] Created volume successfully. Jul 21 02:25:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-130ad32f-2b68-4f58-a1fd-8c0c09a5ac0f tempest-ProjectReaderTests-1799797276 None] Lock "cinder-quobyte-1dcd4564-0eaf-4e19-ac26-19cbcdf65306" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-130ad32f-2b68-4f58-a1fd-8c0c09a5ac0f tempest-ProjectReaderTests-1799797276 None] Acquiring lock "cinder-quobyte-bbc87db0-5f4e-4026-b4f3-e8e1d5d49fc1" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-130ad32f-2b68-4f58-a1fd-8c0c09a5ac0f tempest-ProjectReaderTests-1799797276 None] Lock "cinder-quobyte-bbc87db0-5f4e-4026-b4f3-e8e1d5d49fc1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:30 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-130ad32f-2b68-4f58-a1fd-8c0c09a5ac0f tempest-ProjectReaderTests-1799797276 None] Deleting offline snapshot bbc87db0-5f4e-4026-b4f3-e8e1d5d49fc1 of volume 1dcd4564-0eaf-4e19-ac26-19cbcdf65306 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:25:30 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-130ad32f-2b68-4f58-a1fd-8c0c09a5ac0f tempest-ProjectReaderTests-1799797276 None] snapshot_file for this snap is: volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306.bbc87db0-5f4e-4026-b4f3-e8e1d5d49fc1 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:25:30 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[7870a705-8681-4ff7-b307-08440fbeee94]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-130ad32f-2b68-4f58-a1fd-8c0c09a5ac0f tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306.bbc87db0-5f4e-4026-b4f3-e8e1d5d49fc1 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:31 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306.bbc87db0-5f4e-4026-b4f3-e8e1d5d49fc1 Jul 21 02:25:31 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:31 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-130ad32f-2b68-4f58-a1fd-8c0c09a5ac0f tempest-ProjectReaderTests-1799797276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306.bbc87db0-5f4e-4026-b4f3-e8e1d5d49fc1" returned: 0 in 0.404s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:31 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-130ad32f-2b68-4f58-a1fd-8c0c09a5ac0f tempest-ProjectReaderTests-1799797276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:25:31 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08a02e6-7b66-4172-9348-e766a65cce33]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-130ad32f-2b68-4f58-a1fd-8c0c09a5ac0f tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:31 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306 Jul 21 02:25:31 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:31 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-130ad32f-2b68-4f58-a1fd-8c0c09a5ac0f tempest-ProjectReaderTests-1799797276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306" returned: 0 in 0.411s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-130ad32f-2b68-4f58-a1fd-8c0c09a5ac0f tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306.bbc87db0-5f4e-4026-b4f3-e8e1d5d49fc1 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:31 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306.bbc87db0-5f4e-4026-b4f3-e8e1d5d49fc1 Jul 21 02:25:31 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-753e7d40-63ea-4125-8b9f-80dfc7b48572 tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-753e7d40-63ea-4125-8b9f-80dfc7b48572 tempest-ProjectMemberTests-723363327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:32 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-753e7d40-63ea-4125-8b9f-80dfc7b48572 tempest-ProjectMemberTests-723363327 None] Creating offline snapshot 7fa1c702-9e27-4c08-b69c-4cba800b3f23 of volume fe00f72c-c554-421b-9868-428b246897f5 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:25:32 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa902862-b596-4d9f-a82f-afc2075929e5]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-753e7d40-63ea-4125-8b9f-80dfc7b48572 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:32 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-130ad32f-2b68-4f58-a1fd-8c0c09a5ac0f tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306.bbc87db0-5f4e-4026-b4f3-e8e1d5d49fc1" returned: 0 in 0.487s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-130ad32f-2b68-4f58-a1fd-8c0c09a5ac0f tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306.bbc87db0-5f4e-4026-b4f3-e8e1d5d49fc1 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:32 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306.bbc87db0-5f4e-4026-b4f3-e8e1d5d49fc1 Jul 21 02:25:32 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:32 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5 Jul 21 02:25:32 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:32 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-130ad32f-2b68-4f58-a1fd-8c0c09a5ac0f tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306.bbc87db0-5f4e-4026-b4f3-e8e1d5d49fc1" returned: 0 in 0.361s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:32 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-130ad32f-2b68-4f58-a1fd-8c0c09a5ac0f tempest-ProjectReaderTests-1799797276 None] Lock "cinder-quobyte-bbc87db0-5f4e-4026-b4f3-e8e1d5d49fc1" released by "_delete_snapshot" :: held 1.785s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:32 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-130ad32f-2b68-4f58-a1fd-8c0c09a5ac0f tempest-ProjectReaderTests-1799797276 None] Lock "cinder-quobyte-1dcd4564-0eaf-4e19-ac26-19cbcdf65306" released by "delete_snapshot" :: held 1.816s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:32 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-130ad32f-2b68-4f58-a1fd-8c0c09a5ac0f tempest-ProjectReaderTests-1799797276 None] Created reservations ['9a8b7c58-72d6-4537-baaa-10cbf6a8d30c', '490ece99-5862-455d-b335-b2ba2317d92a', 'a09f1820-5868-4885-b42c-8ee3255e63f2', 'ae42670e-2aaa-4806-b902-7ed8aa09ea2d'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:32 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-130ad32f-2b68-4f58-a1fd-8c0c09a5ac0f tempest-ProjectReaderTests-1799797276 None] Delete snapshot completed successfully. Jul 21 02:25:32 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-130ad32f-2b68-4f58-a1fd-8c0c09a5ac0f tempest-ProjectReaderTests-1799797276 None] Lock "cinder-bbc87db0-5f4e-4026-b4f3-e8e1d5d49fc1-delete_snapshot" released by "delete_snapshot" :: held 1.978s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:32 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-753e7d40-63ea-4125-8b9f-80dfc7b48572 tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5" returned: 0 in 0.577s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-753e7d40-63ea-4125-8b9f-80dfc7b48572 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5.7fa1c702-9e27-4c08-b69c-4cba800b3f23 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:32 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5.7fa1c702-9e27-4c08-b69c-4cba800b3f23 1G Jul 21 02:25:32 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:32 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-5612f967-4c34-4491-99a6-6d0d924da42c tempest-ProjectReaderTests-1799797276 None] Acquiring lock "cinder-1dcd4564-0eaf-4e19-ac26-19cbcdf65306-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:33 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-5612f967-4c34-4491-99a6-6d0d924da42c tempest-ProjectReaderTests-1799797276 None] Lock "cinder-1dcd4564-0eaf-4e19-ac26-19cbcdf65306-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:33 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-5612f967-4c34-4491-99a6-6d0d924da42c tempest-ProjectReaderTests-1799797276 None] Acquiring lock "cinder-quobyte-1dcd4564-0eaf-4e19-ac26-19cbcdf65306" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:33 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-5612f967-4c34-4491-99a6-6d0d924da42c tempest-ProjectReaderTests-1799797276 None] Lock "cinder-quobyte-1dcd4564-0eaf-4e19-ac26-19cbcdf65306" acquired by "delete_volume" :: waited 0.015s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:33 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[a600b725-03e4-4271-8360-43dbf5fcf56a]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5612f967-4c34-4491-99a6-6d0d924da42c tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:33 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306 Jul 21 02:25:33 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:33 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-753e7d40-63ea-4125-8b9f-80dfc7b48572 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5.7fa1c702-9e27-4c08-b69c-4cba800b3f23 1G" returned: 0 in 0.463s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-753e7d40-63ea-4125-8b9f-80dfc7b48572 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe00f72c-c554-421b-9868-428b246897f5 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5.7fa1c702-9e27-4c08-b69c-4cba800b3f23 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:33 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe00f72c-c554-421b-9868-428b246897f5 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5.7fa1c702-9e27-4c08-b69c-4cba800b3f23 Jul 21 02:25:33 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:33 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5612f967-4c34-4491-99a6-6d0d924da42c tempest-ProjectReaderTests-1799797276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306" returned: 0 in 0.429s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5612f967-4c34-4491-99a6-6d0d924da42c tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:33 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306 Jul 21 02:25:33 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:33 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-753e7d40-63ea-4125-8b9f-80dfc7b48572 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe00f72c-c554-421b-9868-428b246897f5 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5.7fa1c702-9e27-4c08-b69c-4cba800b3f23" returned: 0 in 0.356s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:33 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-753e7d40-63ea-4125-8b9f-80dfc7b48572 tempest-ProjectMemberTests-723363327 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5.7fa1c702-9e27-4c08-b69c-4cba800b3f23 is being set with open permissions: ugo+rw Jul 21 02:25:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-753e7d40-63ea-4125-8b9f-80dfc7b48572 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5.7fa1c702-9e27-4c08-b69c-4cba800b3f23 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:33 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5.7fa1c702-9e27-4c08-b69c-4cba800b3f23 Jul 21 02:25:33 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:33 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5612f967-4c34-4491-99a6-6d0d924da42c tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-1dcd4564-0eaf-4e19-ac26-19cbcdf65306" returned: 0 in 0.306s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:33 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-5612f967-4c34-4491-99a6-6d0d924da42c tempest-ProjectReaderTests-1799797276 None] Lock "cinder-quobyte-1dcd4564-0eaf-4e19-ac26-19cbcdf65306" released by "delete_volume" :: held 0.805s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:33 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:33 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-5612f967-4c34-4491-99a6-6d0d924da42c tempest-ProjectReaderTests-1799797276 None] Created reservations ['7b21a112-2f0b-47a6-80bc-2805a93b3447', '6d48f49b-e0a0-4013-89fa-251b663d3f57', '7affae13-d363-4e3b-bf1f-a904d2215437', 'f5ad2644-d1fa-4b85-b3a5-ea592d2d73b3'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-753e7d40-63ea-4125-8b9f-80dfc7b48572 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5.7fa1c702-9e27-4c08-b69c-4cba800b3f23" returned: 0 in 0.322s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-753e7d40-63ea-4125-8b9f-80dfc7b48572 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:34 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5.info Jul 21 02:25:34 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5612f967-4c34-4491-99a6-6d0d924da42c tempest-ProjectReaderTests-1799797276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5612f967-4c34-4491-99a6-6d0d924da42c tempest-ProjectReaderTests-1799797276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-5612f967-4c34-4491-99a6-6d0d924da42c tempest-ProjectReaderTests-1799797276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-5612f967-4c34-4491-99a6-6d0d924da42c tempest-ProjectReaderTests-1799797276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5612f967-4c34-4491-99a6-6d0d924da42c tempest-ProjectReaderTests-1799797276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5612f967-4c34-4491-99a6-6d0d924da42c tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:34 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:25:34 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:34 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-753e7d40-63ea-4125-8b9f-80dfc7b48572 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5.info" returned: 0 in 0.333s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:34 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-753e7d40-63ea-4125-8b9f-80dfc7b48572 tempest-ProjectMemberTests-723363327 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5.info is being set with open permissions: ugo+rw Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-753e7d40-63ea-4125-8b9f-80dfc7b48572 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:34 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5612f967-4c34-4491-99a6-6d0d924da42c tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.294s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-5612f967-4c34-4491-99a6-6d0d924da42c tempest-ProjectReaderTests-1799797276 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:25:34 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-5612f967-4c34-4491-99a6-6d0d924da42c tempest-ProjectReaderTests-1799797276 None] Deleted volume successfully. Jul 21 02:25:34 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5.info Jul 21 02:25:34 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-5612f967-4c34-4491-99a6-6d0d924da42c tempest-ProjectReaderTests-1799797276 None] Lock "cinder-1dcd4564-0eaf-4e19-ac26-19cbcdf65306-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:34 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-753e7d40-63ea-4125-8b9f-80dfc7b48572 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5.info" returned: 0 in 0.353s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-753e7d40-63ea-4125-8b9f-80dfc7b48572 tempest-ProjectMemberTests-723363327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.520s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:34 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-753e7d40-63ea-4125-8b9f-80dfc7b48572 tempest-ProjectMemberTests-723363327 None] Create snapshot completed successfully Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] Flow 'volume_create_manager' (d4d46b92-ec6d-4e5c-bb44-e780039661a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd1361c8-f7ce-46d3-896b-9e5d9345cf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd1361c8-f7ce-46d3-896b-9e5d9345cf6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1214622695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d4707d-48ea-49e1-9bca-75d6519b1d04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2b951dc489e4fb2beadcd7e6effef75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:35Z,use_quota=True,user_id='b415ece141044ee59134455fa2c42a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb3340f-517e-49f0-aa7f-08e5d87ca36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb3340f-517e-49f0-aa7f-08e5d87ca36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b70fc3f-43e0-4632-9b13-adfe9edb2320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b70fc3f-43e0-4632-9b13-adfe9edb2320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9d4707d-48ea-49e1-9bca-75d6519b1d04', 'volume_name': 'volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a683622d-a317-4c79-b3e1-c22ae2e68ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a683622d-a317-4c79-b3e1-c22ae2e68ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a041a824-456d-41e3-8d45-da2755b2a79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:34 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] Volume b9d4707d-48ea-49e1-9bca-75d6519b1d04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04', 'volume_size': 1} Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1214622695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d4707d-48ea-49e1-9bca-75d6519b1d04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2b951dc489e4fb2beadcd7e6effef75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:35Z,use_quota=True,user_id='b415ece141044ee59134455fa2c42a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] Creating volume b9d4707d-48ea-49e1-9bca-75d6519b1d04 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:25:34 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:25:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:35 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04 1073741824 Jul 21 02:25:35 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:35 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-07cf26f9-0b3b-4174-b5a8-a7fa5a0b9319 tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-7fa1c702-9e27-4c08-b69c-4cba800b3f23-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:35 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-07cf26f9-0b3b-4174-b5a8-a7fa5a0b9319 tempest-ProjectMemberTests-723363327 None] Lock "cinder-7fa1c702-9e27-4c08-b69c-4cba800b3f23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:35 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-07cf26f9-0b3b-4174-b5a8-a7fa5a0b9319 tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-quobyte-fe00f72c-c554-421b-9868-428b246897f5" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:35 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-07cf26f9-0b3b-4174-b5a8-a7fa5a0b9319 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-fe00f72c-c554-421b-9868-428b246897f5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:35 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-07cf26f9-0b3b-4174-b5a8-a7fa5a0b9319 tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-quobyte-7fa1c702-9e27-4c08-b69c-4cba800b3f23" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:35 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:35 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-07cf26f9-0b3b-4174-b5a8-a7fa5a0b9319 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-7fa1c702-9e27-4c08-b69c-4cba800b3f23" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:35 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-07cf26f9-0b3b-4174-b5a8-a7fa5a0b9319 tempest-ProjectMemberTests-723363327 None] Deleting offline snapshot 7fa1c702-9e27-4c08-b69c-4cba800b3f23 of volume fe00f72c-c554-421b-9868-428b246897f5 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:25:35 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-07cf26f9-0b3b-4174-b5a8-a7fa5a0b9319 tempest-ProjectMemberTests-723363327 None] snapshot_file for this snap is: volume-fe00f72c-c554-421b-9868-428b246897f5.7fa1c702-9e27-4c08-b69c-4cba800b3f23 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:25:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04 1073741824" returned: 0 in 0.552s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:35 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6da9dfb-8527-49af-bbc7-8409f253c0ba]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-07cf26f9-0b3b-4174-b5a8-a7fa5a0b9319 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5.7fa1c702-9e27-4c08-b69c-4cba800b3f23 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:35 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04 Jul 21 02:25:35 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:35 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5.7fa1c702-9e27-4c08-b69c-4cba800b3f23 Jul 21 02:25:35 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:35 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04" returned: 0 in 0.268s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:35 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:25:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:35 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a041a824-456d-41e3-8d45-da2755b2a79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:35 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ae14f2-f12e-4239-8531-18be65534aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:35 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] Volume volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04 (b9d4707d-48ea-49e1-9bca-75d6519b1d04): created successfully Jul 21 02:25:35 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ae14f2-f12e-4239-8531-18be65534aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:35 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] Flow 'volume_create_manager' (d4d46b92-ec6d-4e5c-bb44-e780039661a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:35 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-e8b61eda-d619-48d7-857a-a9fb6683f699 tempest-ProjectReaderTests-1799797276 None] Created volume successfully. Jul 21 02:25:35 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-07cf26f9-0b3b-4174-b5a8-a7fa5a0b9319 tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5.7fa1c702-9e27-4c08-b69c-4cba800b3f23" returned: 0 in 0.438s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:35 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-07cf26f9-0b3b-4174-b5a8-a7fa5a0b9319 tempest-ProjectMemberTests-723363327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe00f72c-c554-421b-9868-428b246897f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:25:35 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[382295c5-2048-4a44-ba69-9ccdd5c48997]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:35 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-07cf26f9-0b3b-4174-b5a8-a7fa5a0b9319 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:36 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5 Jul 21 02:25:36 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:36 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-07cf26f9-0b3b-4174-b5a8-a7fa5a0b9319 tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5" returned: 0 in 0.410s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-07cf26f9-0b3b-4174-b5a8-a7fa5a0b9319 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5.7fa1c702-9e27-4c08-b69c-4cba800b3f23 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:36 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5.7fa1c702-9e27-4c08-b69c-4cba800b3f23 Jul 21 02:25:36 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:36 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-07cf26f9-0b3b-4174-b5a8-a7fa5a0b9319 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5.7fa1c702-9e27-4c08-b69c-4cba800b3f23" returned: 0 in 0.481s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-07cf26f9-0b3b-4174-b5a8-a7fa5a0b9319 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5.7fa1c702-9e27-4c08-b69c-4cba800b3f23 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:36 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5.7fa1c702-9e27-4c08-b69c-4cba800b3f23 Jul 21 02:25:36 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9be3da5e-ba4d-42c0-b332-29885805ff6e tempest-ProjectReaderTests-1799797276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9be3da5e-ba4d-42c0-b332-29885805ff6e tempest-ProjectReaderTests-1799797276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:37 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-9be3da5e-ba4d-42c0-b332-29885805ff6e tempest-ProjectReaderTests-1799797276 None] Creating offline snapshot c641651c-038e-418c-9542-1b9d19927064 of volume b9d4707d-48ea-49e1-9bca-75d6519b1d04 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:25:37 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-07cf26f9-0b3b-4174-b5a8-a7fa5a0b9319 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5.7fa1c702-9e27-4c08-b69c-4cba800b3f23" returned: 0 in 0.317s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:37 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd58285f-b82b-43b5-94cd-282d997ac50c]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9be3da5e-ba4d-42c0-b332-29885805ff6e tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:37 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-07cf26f9-0b3b-4174-b5a8-a7fa5a0b9319 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-7fa1c702-9e27-4c08-b69c-4cba800b3f23" released by "_delete_snapshot" :: held 1.764s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:37 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-07cf26f9-0b3b-4174-b5a8-a7fa5a0b9319 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-fe00f72c-c554-421b-9868-428b246897f5" released by "delete_snapshot" :: held 1.794s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:37 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-07cf26f9-0b3b-4174-b5a8-a7fa5a0b9319 tempest-ProjectMemberTests-723363327 None] Created reservations ['1afdf2b0-dbac-41da-87a3-eee8888838ac', '419530a5-daea-43fa-8833-a89235ba68be', 'f6924269-fb60-4b2e-a361-79e4650cdf9f', '309d9add-8a48-44f0-b303-b622caaf019b'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:37 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04 Jul 21 02:25:37 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:37 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-07cf26f9-0b3b-4174-b5a8-a7fa5a0b9319 tempest-ProjectMemberTests-723363327 None] Delete snapshot completed successfully. Jul 21 02:25:37 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-07cf26f9-0b3b-4174-b5a8-a7fa5a0b9319 tempest-ProjectMemberTests-723363327 None] Lock "cinder-7fa1c702-9e27-4c08-b69c-4cba800b3f23-delete_snapshot" released by "delete_snapshot" :: held 1.976s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:37 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-92cd15e8-0afb-43ff-989c-e5d84e9aa06e tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-fe00f72c-c554-421b-9868-428b246897f5-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:37 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-92cd15e8-0afb-43ff-989c-e5d84e9aa06e tempest-ProjectMemberTests-723363327 None] Lock "cinder-fe00f72c-c554-421b-9868-428b246897f5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:37 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-92cd15e8-0afb-43ff-989c-e5d84e9aa06e tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-quobyte-fe00f72c-c554-421b-9868-428b246897f5" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:37 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-92cd15e8-0afb-43ff-989c-e5d84e9aa06e tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-fe00f72c-c554-421b-9868-428b246897f5" acquired by "delete_volume" :: waited 0.016s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:37 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9be3da5e-ba4d-42c0-b332-29885805ff6e tempest-ProjectReaderTests-1799797276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04" returned: 0 in 0.589s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9be3da5e-ba4d-42c0-b332-29885805ff6e tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04.c641651c-038e-418c-9542-1b9d19927064 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:37 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cd29c8-98a5-4baf-ba41-22476a0a5f78]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-92cd15e8-0afb-43ff-989c-e5d84e9aa06e tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:37 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04.c641651c-038e-418c-9542-1b9d19927064 1G Jul 21 02:25:37 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:37 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5 Jul 21 02:25:37 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:38 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9be3da5e-ba4d-42c0-b332-29885805ff6e tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04.c641651c-038e-418c-9542-1b9d19927064 1G" returned: 0 in 0.473s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9be3da5e-ba4d-42c0-b332-29885805ff6e tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04.c641651c-038e-418c-9542-1b9d19927064 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:38 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-92cd15e8-0afb-43ff-989c-e5d84e9aa06e tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5" returned: 0 in 0.491s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-92cd15e8-0afb-43ff-989c-e5d84e9aa06e tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:38 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04.c641651c-038e-418c-9542-1b9d19927064 Jul 21 02:25:38 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:38 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5 Jul 21 02:25:38 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:38 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-92cd15e8-0afb-43ff-989c-e5d84e9aa06e tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fe00f72c-c554-421b-9868-428b246897f5" returned: 0 in 0.281s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:38 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:38 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-92cd15e8-0afb-43ff-989c-e5d84e9aa06e tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-fe00f72c-c554-421b-9868-428b246897f5" released by "delete_volume" :: held 0.846s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9be3da5e-ba4d-42c0-b332-29885805ff6e tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04.c641651c-038e-418c-9542-1b9d19927064" returned: 0 in 0.344s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:38 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-9be3da5e-ba4d-42c0-b332-29885805ff6e tempest-ProjectReaderTests-1799797276 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04.c641651c-038e-418c-9542-1b9d19927064 is being set with open permissions: ugo+rw Jul 21 02:25:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9be3da5e-ba4d-42c0-b332-29885805ff6e tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04.c641651c-038e-418c-9542-1b9d19927064 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:38 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04.c641651c-038e-418c-9542-1b9d19927064 Jul 21 02:25:38 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:38 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-92cd15e8-0afb-43ff-989c-e5d84e9aa06e tempest-ProjectMemberTests-723363327 None] Created reservations ['4143199f-0a2b-4396-839e-766816af33b1', 'ee5bb1d7-8364-4e6b-b816-9bd36ced2761', '0e4fabbc-b5b6-43d8-87da-52659c6e39d3', '2849483a-52c8-4d58-aed2-edb3c8bc7aca'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-92cd15e8-0afb-43ff-989c-e5d84e9aa06e tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-92cd15e8-0afb-43ff-989c-e5d84e9aa06e tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:38 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-92cd15e8-0afb-43ff-989c-e5d84e9aa06e tempest-ProjectMemberTests-723363327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:38 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-92cd15e8-0afb-43ff-989c-e5d84e9aa06e tempest-ProjectMemberTests-723363327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-92cd15e8-0afb-43ff-989c-e5d84e9aa06e tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-92cd15e8-0afb-43ff-989c-e5d84e9aa06e tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:38 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:25:38 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:38 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9be3da5e-ba4d-42c0-b332-29885805ff6e tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04.c641651c-038e-418c-9542-1b9d19927064" returned: 0 in 0.309s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9be3da5e-ba4d-42c0-b332-29885805ff6e tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:39 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04.info Jul 21 02:25:39 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:39 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-92cd15e8-0afb-43ff-989c-e5d84e9aa06e tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.468s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:39 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-92cd15e8-0afb-43ff-989c-e5d84e9aa06e tempest-ProjectMemberTests-723363327 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:25:39 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-92cd15e8-0afb-43ff-989c-e5d84e9aa06e tempest-ProjectMemberTests-723363327 None] Deleted volume successfully. Jul 21 02:25:39 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-92cd15e8-0afb-43ff-989c-e5d84e9aa06e tempest-ProjectMemberTests-723363327 None] Lock "cinder-fe00f72c-c554-421b-9868-428b246897f5-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:39 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9be3da5e-ba4d-42c0-b332-29885805ff6e tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04.info" returned: 0 in 0.382s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:39 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-9be3da5e-ba4d-42c0-b332-29885805ff6e tempest-ProjectReaderTests-1799797276 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04.info is being set with open permissions: ugo+rw Jul 21 02:25:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9be3da5e-ba4d-42c0-b332-29885805ff6e tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:39 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04.info Jul 21 02:25:39 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:39 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:25:39 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] Flow 'volume_create_manager' (f798e7bd-fb1f-40a4-a0d3-49b3c02150d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:39 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d078195-2bf1-4a26-8be8-6a01a9834929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:39 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d078195-2bf1-4a26-8be8-6a01a9834929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-644438706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4257003-568e-4e95-8b7d-e069570d9c03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9180fe803c342ad96c373b69434c36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:39Z,use_quota=True,user_id='33a1095c5e17461e8e8a710d76a95247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:39 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3fd97d-4da6-4f89-88d6-7768ebb83ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:39 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3fd97d-4da6-4f89-88d6-7768ebb83ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:39 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be887346-94ac-479c-b534-723ff2225c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:39 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be887346-94ac-479c-b534-723ff2225c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4257003-568e-4e95-8b7d-e069570d9c03', 'volume_name': 'volume-e4257003-568e-4e95-8b7d-e069570d9c03', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:39 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3761772e-1c60-49e5-a772-8bb3f6cf80a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:39 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3761772e-1c60-49e5-a772-8bb3f6cf80a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:39 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc5467b-0dca-4baa-8ef4-83222f1ab229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:39 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] Volume e4257003-568e-4e95-8b7d-e069570d9c03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4257003-568e-4e95-8b7d-e069570d9c03', 'volume_size': 1} Jul 21 02:25:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:39 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9be3da5e-ba4d-42c0-b332-29885805ff6e tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04.info" returned: 0 in 0.285s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9be3da5e-ba4d-42c0-b332-29885805ff6e tempest-ProjectReaderTests-1799797276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.491s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.070s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-644438706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4257003-568e-4e95-8b7d-e069570d9c03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9180fe803c342ad96c373b69434c36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:39Z,use_quota=True,user_id='33a1095c5e17461e8e8a710d76a95247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:25:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] Creating volume e4257003-568e-4e95-8b7d-e069570d9c03 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:25:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:25:39 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:25:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:39 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-9be3da5e-ba4d-42c0-b332-29885805ff6e tempest-ProjectReaderTests-1799797276 None] Create snapshot completed successfully Jul 21 02:25:39 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03 1073741824 Jul 21 02:25:39 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:40 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03 1073741824" returned: 0 in 0.519s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:40 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03 Jul 21 02:25:40 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:40 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f5afc8e4-c0c9-4b6e-847d-913040700ade tempest-ProjectReaderTests-1799797276 None] Acquiring lock "cinder-c641651c-038e-418c-9542-1b9d19927064-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:40 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f5afc8e4-c0c9-4b6e-847d-913040700ade tempest-ProjectReaderTests-1799797276 None] Lock "cinder-c641651c-038e-418c-9542-1b9d19927064-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:40 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f5afc8e4-c0c9-4b6e-847d-913040700ade tempest-ProjectReaderTests-1799797276 None] Acquiring lock "cinder-quobyte-b9d4707d-48ea-49e1-9bca-75d6519b1d04" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:40 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f5afc8e4-c0c9-4b6e-847d-913040700ade tempest-ProjectReaderTests-1799797276 None] Lock "cinder-quobyte-b9d4707d-48ea-49e1-9bca-75d6519b1d04" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:40 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f5afc8e4-c0c9-4b6e-847d-913040700ade tempest-ProjectReaderTests-1799797276 None] Acquiring lock "cinder-quobyte-c641651c-038e-418c-9542-1b9d19927064" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:40 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f5afc8e4-c0c9-4b6e-847d-913040700ade tempest-ProjectReaderTests-1799797276 None] Lock "cinder-quobyte-c641651c-038e-418c-9542-1b9d19927064" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:40 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-f5afc8e4-c0c9-4b6e-847d-913040700ade tempest-ProjectReaderTests-1799797276 None] Deleting offline snapshot c641651c-038e-418c-9542-1b9d19927064 of volume b9d4707d-48ea-49e1-9bca-75d6519b1d04 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:25:40 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-f5afc8e4-c0c9-4b6e-847d-913040700ade tempest-ProjectReaderTests-1799797276 None] snapshot_file for this snap is: volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04.c641651c-038e-418c-9542-1b9d19927064 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:25:40 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a460405-746b-432a-b6df-b70ed9cbfa55]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f5afc8e4-c0c9-4b6e-847d-913040700ade tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04.c641651c-038e-418c-9542-1b9d19927064 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:40 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03" returned: 0 in 0.371s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:40 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:25:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:40 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc5467b-0dca-4baa-8ef4-83222f1ab229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4257003-568e-4e95-8b7d-e069570d9c03', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:40 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c469bd08-dc14-49e0-a8c3-5f3ebfa464c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:40 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04.c641651c-038e-418c-9542-1b9d19927064 Jul 21 02:25:40 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:40 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] Volume volume-e4257003-568e-4e95-8b7d-e069570d9c03 (e4257003-568e-4e95-8b7d-e069570d9c03): created successfully Jul 21 02:25:40 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c469bd08-dc14-49e0-a8c3-5f3ebfa464c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:40 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] Flow 'volume_create_manager' (f798e7bd-fb1f-40a4-a0d3-49b3c02150d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:40 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-059d8188-57c4-47c0-963b-27fffbd60dbb tempest-ProjectMemberTests-723363327 None] Created volume successfully. Jul 21 02:25:40 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f5afc8e4-c0c9-4b6e-847d-913040700ade tempest-ProjectReaderTests-1799797276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04.c641651c-038e-418c-9542-1b9d19927064" returned: 0 in 0.383s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:40 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-f5afc8e4-c0c9-4b6e-847d-913040700ade tempest-ProjectReaderTests-1799797276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:25:40 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d7927f-c095-42dd-bdff-5e264981c5f3]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f5afc8e4-c0c9-4b6e-847d-913040700ade tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:41 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04 Jul 21 02:25:41 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:41 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f5afc8e4-c0c9-4b6e-847d-913040700ade tempest-ProjectReaderTests-1799797276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04" returned: 0 in 0.381s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f5afc8e4-c0c9-4b6e-847d-913040700ade tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04.c641651c-038e-418c-9542-1b9d19927064 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:41 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04.c641651c-038e-418c-9542-1b9d19927064 Jul 21 02:25:41 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:41 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f5afc8e4-c0c9-4b6e-847d-913040700ade tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04.c641651c-038e-418c-9542-1b9d19927064" returned: 0 in 0.498s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f5afc8e4-c0c9-4b6e-847d-913040700ade tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04.c641651c-038e-418c-9542-1b9d19927064 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:41 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04.c641651c-038e-418c-9542-1b9d19927064 Jul 21 02:25:41 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-343674f6-d851-4081-8ef8-9c11ab59944a tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-343674f6-d851-4081-8ef8-9c11ab59944a tempest-ProjectMemberTests-723363327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:41 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-343674f6-d851-4081-8ef8-9c11ab59944a tempest-ProjectMemberTests-723363327 None] Creating offline snapshot 90bd524d-df6a-48bd-8a73-16b06020b88e of volume e4257003-568e-4e95-8b7d-e069570d9c03 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:25:41 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab7b1b2-7ff8-4358-9e88-79338a4f0143]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-343674f6-d851-4081-8ef8-9c11ab59944a tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:42 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03 Jul 21 02:25:42 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:42 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f5afc8e4-c0c9-4b6e-847d-913040700ade tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04.c641651c-038e-418c-9542-1b9d19927064" returned: 0 in 0.312s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:42 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f5afc8e4-c0c9-4b6e-847d-913040700ade tempest-ProjectReaderTests-1799797276 None] Lock "cinder-quobyte-c641651c-038e-418c-9542-1b9d19927064" released by "_delete_snapshot" :: held 1.704s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:42 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f5afc8e4-c0c9-4b6e-847d-913040700ade tempest-ProjectReaderTests-1799797276 None] Lock "cinder-quobyte-b9d4707d-48ea-49e1-9bca-75d6519b1d04" released by "delete_snapshot" :: held 1.734s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:42 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-f5afc8e4-c0c9-4b6e-847d-913040700ade tempest-ProjectReaderTests-1799797276 None] Created reservations ['ce9fa259-d401-4814-b091-a096fb2bd798', '67e224d0-c93e-4094-b752-15e65bca7ba3', '6fb09579-1d45-4b2f-a871-51589f18287e', '3de7b42c-8225-4a5e-b22c-041c5ab687d5'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:42 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-343674f6-d851-4081-8ef8-9c11ab59944a tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03" returned: 0 in 0.460s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-343674f6-d851-4081-8ef8-9c11ab59944a tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03.90bd524d-df6a-48bd-8a73-16b06020b88e 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:42 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03.90bd524d-df6a-48bd-8a73-16b06020b88e 1G Jul 21 02:25:42 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:42 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-f5afc8e4-c0c9-4b6e-847d-913040700ade tempest-ProjectReaderTests-1799797276 None] Delete snapshot completed successfully. Jul 21 02:25:42 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-f5afc8e4-c0c9-4b6e-847d-913040700ade tempest-ProjectReaderTests-1799797276 None] Lock "cinder-c641651c-038e-418c-9542-1b9d19927064-delete_snapshot" released by "delete_snapshot" :: held 2.023s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:42 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c47c7550-7c9a-4e7c-af3c-edaaab637b6c tempest-ProjectReaderTests-1799797276 None] Acquiring lock "cinder-b9d4707d-48ea-49e1-9bca-75d6519b1d04-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:42 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c47c7550-7c9a-4e7c-af3c-edaaab637b6c tempest-ProjectReaderTests-1799797276 None] Lock "cinder-b9d4707d-48ea-49e1-9bca-75d6519b1d04-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:42 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c47c7550-7c9a-4e7c-af3c-edaaab637b6c tempest-ProjectReaderTests-1799797276 None] Acquiring lock "cinder-quobyte-b9d4707d-48ea-49e1-9bca-75d6519b1d04" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:42 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c47c7550-7c9a-4e7c-af3c-edaaab637b6c tempest-ProjectReaderTests-1799797276 None] Lock "cinder-quobyte-b9d4707d-48ea-49e1-9bca-75d6519b1d04" acquired by "delete_volume" :: waited 0.014s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:42 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a554b7-d37f-40b0-bce6-7a6f89d8dbee]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c47c7550-7c9a-4e7c-af3c-edaaab637b6c tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:42 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04 Jul 21 02:25:42 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:42 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-343674f6-d851-4081-8ef8-9c11ab59944a tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03.90bd524d-df6a-48bd-8a73-16b06020b88e 1G" returned: 0 in 0.554s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-343674f6-d851-4081-8ef8-9c11ab59944a tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4257003-568e-4e95-8b7d-e069570d9c03 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03.90bd524d-df6a-48bd-8a73-16b06020b88e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:42 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4257003-568e-4e95-8b7d-e069570d9c03 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03.90bd524d-df6a-48bd-8a73-16b06020b88e Jul 21 02:25:42 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:43 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c47c7550-7c9a-4e7c-af3c-edaaab637b6c tempest-ProjectReaderTests-1799797276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04" returned: 0 in 0.426s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c47c7550-7c9a-4e7c-af3c-edaaab637b6c tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:43 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04 Jul 21 02:25:43 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:43 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:25:43 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] Flow 'volume_create_manager' (c1a8400f-f854-4bd2-85ad-ad605526bdec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:43 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e753cf44-72a0-41d4-97e7-ede2e2866d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:43 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e753cf44-72a0-41d4-97e7-ede2e2866d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1167725555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e438ca1a-9d78-453c-a5d2-e4e16f933f5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0821ad9feafe4fe7a545ff1c0ad1ab25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:43Z,use_quota=True,user_id='c6f0983d3ab4498cb3fc0f0f4b3c0ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:43 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae243df-3912-4805-acb6-9996f6e69b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:43 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:43 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae243df-3912-4805-acb6-9996f6e69b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:43 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faea5fc4-2e14-4b1f-8c7e-33bed46c5a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:43 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faea5fc4-2e14-4b1f-8c7e-33bed46c5a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e438ca1a-9d78-453c-a5d2-e4e16f933f5b', 'volume_name': 'volume-e438ca1a-9d78-453c-a5d2-e4e16f933f5b', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:43 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e52751d5-d464-42ea-9f76-71f830b06817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:43 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e52751d5-d464-42ea-9f76-71f830b06817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:43 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02064ec2-8f07-410c-a443-85af6a2e6fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:43 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] Volume e438ca1a-9d78-453c-a5d2-e4e16f933f5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e438ca1a-9d78-453c-a5d2-e4e16f933f5b', 'volume_size': 1} Jul 21 02:25:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-343674f6-d851-4081-8ef8-9c11ab59944a tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4257003-568e-4e95-8b7d-e069570d9c03 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03.90bd524d-df6a-48bd-8a73-16b06020b88e" returned: 0 in 0.378s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:43 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-343674f6-d851-4081-8ef8-9c11ab59944a tempest-ProjectMemberTests-723363327 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03.90bd524d-df6a-48bd-8a73-16b06020b88e is being set with open permissions: ugo+rw Jul 21 02:25:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-343674f6-d851-4081-8ef8-9c11ab59944a tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03.90bd524d-df6a-48bd-8a73-16b06020b88e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:43 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03.90bd524d-df6a-48bd-8a73-16b06020b88e Jul 21 02:25:43 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:43 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c47c7550-7c9a-4e7c-af3c-edaaab637b6c tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b9d4707d-48ea-49e1-9bca-75d6519b1d04" returned: 0 in 0.274s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:43 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c47c7550-7c9a-4e7c-af3c-edaaab637b6c tempest-ProjectReaderTests-1799797276 None] Lock "cinder-quobyte-b9d4707d-48ea-49e1-9bca-75d6519b1d04" released by "delete_volume" :: held 0.780s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:43 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-c47c7550-7c9a-4e7c-af3c-edaaab637b6c tempest-ProjectReaderTests-1799797276 None] Created reservations ['2549815d-1d8c-4034-8651-b4e937a50cda', '1de89428-a8e5-47b2-9606-1a01fef8472b', '902aa6af-abe9-4dbb-85a0-3fdabad4b1d7', 'c6aebb05-74e1-4812-ad7a-7934cec6acb3'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c47c7550-7c9a-4e7c-af3c-edaaab637b6c tempest-ProjectReaderTests-1799797276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c47c7550-7c9a-4e7c-af3c-edaaab637b6c tempest-ProjectReaderTests-1799797276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:43 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c47c7550-7c9a-4e7c-af3c-edaaab637b6c tempest-ProjectReaderTests-1799797276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:43 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-c47c7550-7c9a-4e7c-af3c-edaaab637b6c tempest-ProjectReaderTests-1799797276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c47c7550-7c9a-4e7c-af3c-edaaab637b6c tempest-ProjectReaderTests-1799797276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c47c7550-7c9a-4e7c-af3c-edaaab637b6c tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:43 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-343674f6-d851-4081-8ef8-9c11ab59944a tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03.90bd524d-df6a-48bd-8a73-16b06020b88e" returned: 0 in 0.283s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:43 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:25:43 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-343674f6-d851-4081-8ef8-9c11ab59944a tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:43 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03.info Jul 21 02:25:43 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:43 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c47c7550-7c9a-4e7c-af3c-edaaab637b6c tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.281s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:43 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-c47c7550-7c9a-4e7c-af3c-edaaab637b6c tempest-ProjectReaderTests-1799797276 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:25:43 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-c47c7550-7c9a-4e7c-af3c-edaaab637b6c tempest-ProjectReaderTests-1799797276 None] Deleted volume successfully. Jul 21 02:25:43 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-c47c7550-7c9a-4e7c-af3c-edaaab637b6c tempest-ProjectReaderTests-1799797276 None] Lock "cinder-b9d4707d-48ea-49e1-9bca-75d6519b1d04-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:43 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-343674f6-d851-4081-8ef8-9c11ab59944a tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03.info" returned: 0 in 0.310s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:43 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-343674f6-d851-4081-8ef8-9c11ab59944a tempest-ProjectMemberTests-723363327 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03.info is being set with open permissions: ugo+rw Jul 21 02:25:43 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-343674f6-d851-4081-8ef8-9c11ab59944a tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:43 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03.info Jul 21 02:25:43 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:44 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-343674f6-d851-4081-8ef8-9c11ab59944a tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03.info" returned: 0 in 0.310s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-343674f6-d851-4081-8ef8-9c11ab59944a tempest-ProjectMemberTests-723363327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.383s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.960s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:44 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1167725555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e438ca1a-9d78-453c-a5d2-e4e16f933f5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0821ad9feafe4fe7a545ff1c0ad1ab25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:43Z,use_quota=True,user_id='c6f0983d3ab4498cb3fc0f0f4b3c0ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:25:44 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] Creating volume e438ca1a-9d78-453c-a5d2-e4e16f933f5b {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:25:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:44 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:44 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:44 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:25:44 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:25:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e438ca1a-9d78-453c-a5d2-e4e16f933f5b 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:44 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e438ca1a-9d78-453c-a5d2-e4e16f933f5b 1073741824 Jul 21 02:25:44 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:44 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-343674f6-d851-4081-8ef8-9c11ab59944a tempest-ProjectMemberTests-723363327 None] Create snapshot completed successfully Jul 21 02:25:44 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:25:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] Flow 'volume_create_manager' (963877e6-04a3-46da-a519-cf01411037d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1f78d7-9fdd-4084-9b06-9e396c41dddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1f78d7-9fdd-4084-9b06-9e396c41dddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1802744721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=038c6bdb-a49e-48d6-9f20-78762afc008b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2b951dc489e4fb2beadcd7e6effef75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:44Z,use_quota=True,user_id='b415ece141044ee59134455fa2c42a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e6bf2f-c78e-4b16-973f-2bf0863bdad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e6bf2f-c78e-4b16-973f-2bf0863bdad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c1d9e1f-baa4-47ba-bdec-11f114e8c4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c1d9e1f-baa4-47ba-bdec-11f114e8c4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '038c6bdb-a49e-48d6-9f20-78762afc008b', 'volume_name': 'volume-038c6bdb-a49e-48d6-9f20-78762afc008b', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf2ad81-665f-40ed-895e-ad4e6bc0d0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf2ad81-665f-40ed-895e-ad4e6bc0d0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:44 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d69b8bd5-7be9-4034-9418-d83e723f2da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:44 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] Volume 038c6bdb-a49e-48d6-9f20-78762afc008b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-038c6bdb-a49e-48d6-9f20-78762afc008b', 'volume_size': 1} Jul 21 02:25:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:44 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e438ca1a-9d78-453c-a5d2-e4e16f933f5b 1073741824" returned: 0 in 0.427s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e438ca1a-9d78-453c-a5d2-e4e16f933f5b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:44 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e438ca1a-9d78-453c-a5d2-e4e16f933f5b Jul 21 02:25:44 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:44 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e438ca1a-9d78-453c-a5d2-e4e16f933f5b" returned: 0 in 0.247s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:44 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:25:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:44 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.419s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:44 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1802744721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=038c6bdb-a49e-48d6-9f20-78762afc008b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2b951dc489e4fb2beadcd7e6effef75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:44Z,use_quota=True,user_id='b415ece141044ee59134455fa2c42a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:25:44 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] Creating volume 038c6bdb-a49e-48d6-9f20-78762afc008b {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:25:45 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02064ec2-8f07-410c-a443-85af6a2e6fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e438ca1a-9d78-453c-a5d2-e4e16f933f5b', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:45 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b 1073741824 Jul 21 02:25:45 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7fa9486-47f1-4f54-991c-313a80ddad36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:45 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] Volume volume-e438ca1a-9d78-453c-a5d2-e4e16f933f5b (e438ca1a-9d78-453c-a5d2-e4e16f933f5b): created successfully Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7fa9486-47f1-4f54-991c-313a80ddad36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] Flow 'volume_create_manager' (c1a8400f-f854-4bd2-85ad-ad605526bdec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:45 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-bc7f8618-4e21-4738-9b34-4c211f1497df tempest-ProjectReaderTests-645212503 None] Created volume successfully. Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cc754054-0a18-4277-bff9-e7a7e54f1076 tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-90bd524d-df6a-48bd-8a73-16b06020b88e-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cc754054-0a18-4277-bff9-e7a7e54f1076 tempest-ProjectMemberTests-723363327 None] Lock "cinder-90bd524d-df6a-48bd-8a73-16b06020b88e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cc754054-0a18-4277-bff9-e7a7e54f1076 tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-quobyte-e4257003-568e-4e95-8b7d-e069570d9c03" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cc754054-0a18-4277-bff9-e7a7e54f1076 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-e4257003-568e-4e95-8b7d-e069570d9c03" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cc754054-0a18-4277-bff9-e7a7e54f1076 tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-quobyte-90bd524d-df6a-48bd-8a73-16b06020b88e" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cc754054-0a18-4277-bff9-e7a7e54f1076 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-90bd524d-df6a-48bd-8a73-16b06020b88e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-cc754054-0a18-4277-bff9-e7a7e54f1076 tempest-ProjectMemberTests-723363327 None] Deleting offline snapshot 90bd524d-df6a-48bd-8a73-16b06020b88e of volume e4257003-568e-4e95-8b7d-e069570d9c03 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-cc754054-0a18-4277-bff9-e7a7e54f1076 tempest-ProjectMemberTests-723363327 None] snapshot_file for this snap is: volume-e4257003-568e-4e95-8b7d-e069570d9c03.90bd524d-df6a-48bd-8a73-16b06020b88e {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4a0422-dba2-44dc-907d-015c1f0f64a0]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cc754054-0a18-4277-bff9-e7a7e54f1076 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03.90bd524d-df6a-48bd-8a73-16b06020b88e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:45 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03.90bd524d-df6a-48bd-8a73-16b06020b88e Jul 21 02:25:45 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:45 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b 1073741824" returned: 0 in 0.561s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a06f46c1-08fa-45e3-8c99-9558ec957322 tempest-ProjectReaderTests-645212503 None] Acquiring lock "cinder-e438ca1a-9d78-453c-a5d2-e4e16f933f5b-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a06f46c1-08fa-45e3-8c99-9558ec957322 tempest-ProjectReaderTests-645212503 None] Lock "cinder-e438ca1a-9d78-453c-a5d2-e4e16f933f5b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:45 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b Jul 21 02:25:45 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a06f46c1-08fa-45e3-8c99-9558ec957322 tempest-ProjectReaderTests-645212503 None] Acquiring lock "cinder-quobyte-e438ca1a-9d78-453c-a5d2-e4e16f933f5b" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a06f46c1-08fa-45e3-8c99-9558ec957322 tempest-ProjectReaderTests-645212503 None] Lock "cinder-quobyte-e438ca1a-9d78-453c-a5d2-e4e16f933f5b" acquired by "delete_volume" :: waited 0.016s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3e1008-4d3c-411d-8547-f2b299508f0a]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a06f46c1-08fa-45e3-8c99-9558ec957322 tempest-ProjectReaderTests-645212503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e438ca1a-9d78-453c-a5d2-e4e16f933f5b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:45 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cc754054-0a18-4277-bff9-e7a7e54f1076 tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03.90bd524d-df6a-48bd-8a73-16b06020b88e" returned: 0 in 0.463s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-cc754054-0a18-4277-bff9-e7a7e54f1076 tempest-ProjectMemberTests-723363327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4257003-568e-4e95-8b7d-e069570d9c03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ceecdbb-fa0f-4722-8118-5f9ee1be2f6b]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cc754054-0a18-4277-bff9-e7a7e54f1076 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:45 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e438ca1a-9d78-453c-a5d2-e4e16f933f5b Jul 21 02:25:45 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:45 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b" returned: 0 in 0.314s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d69b8bd5-7be9-4034-9418-d83e723f2da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-038c6bdb-a49e-48d6-9f20-78762afc008b', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:45 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e5f04f5-e4c2-40c3-ae21-1b143c5bf0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:46 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] Volume volume-038c6bdb-a49e-48d6-9f20-78762afc008b (038c6bdb-a49e-48d6-9f20-78762afc008b): created successfully Jul 21 02:25:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e5f04f5-e4c2-40c3-ae21-1b143c5bf0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] Flow 'volume_create_manager' (963877e6-04a3-46da-a519-cf01411037d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:46 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03 Jul 21 02:25:46 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:46 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-5fe170cd-0d56-4575-a4cb-16d5d4da90bf tempest-ProjectReaderTests-1799797276 None] Created volume successfully. Jul 21 02:25:46 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a06f46c1-08fa-45e3-8c99-9558ec957322 tempest-ProjectReaderTests-645212503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e438ca1a-9d78-453c-a5d2-e4e16f933f5b" returned: 0 in 0.419s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a06f46c1-08fa-45e3-8c99-9558ec957322 tempest-ProjectReaderTests-645212503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e438ca1a-9d78-453c-a5d2-e4e16f933f5b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:46 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e438ca1a-9d78-453c-a5d2-e4e16f933f5b Jul 21 02:25:46 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:46 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cc754054-0a18-4277-bff9-e7a7e54f1076 tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03" returned: 0 in 0.438s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cc754054-0a18-4277-bff9-e7a7e54f1076 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03.90bd524d-df6a-48bd-8a73-16b06020b88e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:46 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03.90bd524d-df6a-48bd-8a73-16b06020b88e Jul 21 02:25:46 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:46 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a06f46c1-08fa-45e3-8c99-9558ec957322 tempest-ProjectReaderTests-645212503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e438ca1a-9d78-453c-a5d2-e4e16f933f5b" returned: 0 in 0.306s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:46 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a06f46c1-08fa-45e3-8c99-9558ec957322 tempest-ProjectReaderTests-645212503 None] Lock "cinder-quobyte-e438ca1a-9d78-453c-a5d2-e4e16f933f5b" released by "delete_volume" :: held 0.803s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-963e249c-54ef-4f11-9235-182e43dcbe6f tempest-ProjectReaderTests-1799797276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-963e249c-54ef-4f11-9235-182e43dcbe6f tempest-ProjectReaderTests-1799797276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-963e249c-54ef-4f11-9235-182e43dcbe6f tempest-ProjectReaderTests-1799797276 None] Creating offline snapshot b84666e0-6e62-434e-9dcd-28ff54cde832 of volume 038c6bdb-a49e-48d6-9f20-78762afc008b {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:25:46 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede35713-6859-482f-90b4-f8a62578ccc4]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-963e249c-54ef-4f11-9235-182e43dcbe6f tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:46 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-a06f46c1-08fa-45e3-8c99-9558ec957322 tempest-ProjectReaderTests-645212503 None] Created reservations ['171fd62f-fc08-4b93-891b-950e46f07c4e', '9c221034-d7c0-4d4c-93cc-f0956da1d28d', '8d7df48c-4ec5-4f10-b30d-6c011c0ba325', '112c9f89-6f74-47ed-88ff-e5910564a2a0'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a06f46c1-08fa-45e3-8c99-9558ec957322 tempest-ProjectReaderTests-645212503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a06f46c1-08fa-45e3-8c99-9558ec957322 tempest-ProjectReaderTests-645212503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-a06f46c1-08fa-45e3-8c99-9558ec957322 tempest-ProjectReaderTests-645212503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-a06f46c1-08fa-45e3-8c99-9558ec957322 tempest-ProjectReaderTests-645212503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-a06f46c1-08fa-45e3-8c99-9558ec957322 tempest-ProjectReaderTests-645212503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a06f46c1-08fa-45e3-8c99-9558ec957322 tempest-ProjectReaderTests-645212503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:46 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:25:46 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:46 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cc754054-0a18-4277-bff9-e7a7e54f1076 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03.90bd524d-df6a-48bd-8a73-16b06020b88e" returned: 0 in 0.499s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cc754054-0a18-4277-bff9-e7a7e54f1076 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03.90bd524d-df6a-48bd-8a73-16b06020b88e {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:46 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b Jul 21 02:25:46 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:46 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03.90bd524d-df6a-48bd-8a73-16b06020b88e Jul 21 02:25:46 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:47 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-a06f46c1-08fa-45e3-8c99-9558ec957322 tempest-ProjectReaderTests-645212503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.365s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:47 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-a06f46c1-08fa-45e3-8c99-9558ec957322 tempest-ProjectReaderTests-645212503 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:25:47 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:47 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-a06f46c1-08fa-45e3-8c99-9558ec957322 tempest-ProjectReaderTests-645212503 None] Deleted volume successfully. Jul 21 02:25:47 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-963e249c-54ef-4f11-9235-182e43dcbe6f tempest-ProjectReaderTests-1799797276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b" returned: 0 in 0.508s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-963e249c-54ef-4f11-9235-182e43dcbe6f tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b.b84666e0-6e62-434e-9dcd-28ff54cde832 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cc754054-0a18-4277-bff9-e7a7e54f1076 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03.90bd524d-df6a-48bd-8a73-16b06020b88e" returned: 0 in 0.339s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:47 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b.b84666e0-6e62-434e-9dcd-28ff54cde832 1G Jul 21 02:25:47 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cc754054-0a18-4277-bff9-e7a7e54f1076 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-90bd524d-df6a-48bd-8a73-16b06020b88e" released by "_delete_snapshot" :: held 1.872s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cc754054-0a18-4277-bff9-e7a7e54f1076 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-e4257003-568e-4e95-8b7d-e069570d9c03" released by "delete_snapshot" :: held 1.917s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-a06f46c1-08fa-45e3-8c99-9558ec957322 tempest-ProjectReaderTests-645212503 None] Lock "cinder-e438ca1a-9d78-453c-a5d2-e4e16f933f5b-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:47 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-cc754054-0a18-4277-bff9-e7a7e54f1076 tempest-ProjectMemberTests-723363327 None] Created reservations ['7b189115-f4da-4930-96bc-78df347751c4', 'd5ea642d-9802-4dd6-99bb-021897ab4334', '4e0b854e-7740-4e27-a157-cc16d4603d72', 'b72ef2e1-e03c-445f-8de1-3e11ab3d5ab5'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:47 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:25:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] Flow 'volume_create_manager' (38f5b299-9076-4fb2-8afd-89063b702e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (991f2e67-ba86-410f-b8fe-acca1de40494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:47 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-cc754054-0a18-4277-bff9-e7a7e54f1076 tempest-ProjectMemberTests-723363327 None] Delete snapshot completed successfully. Jul 21 02:25:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (991f2e67-ba86-410f-b8fe-acca1de40494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-601495639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0149cd-b471-4b6a-bb38-e39cc3402404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0821ad9feafe4fe7a545ff1c0ad1ab25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:47Z,use_quota=True,user_id='c6f0983d3ab4498cb3fc0f0f4b3c0ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38f5b243-b99c-4b2b-a507-b94dc0c363e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38f5b243-b99c-4b2b-a507-b94dc0c363e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (919c4418-b461-4728-9f3e-53ef9c8b9aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (919c4418-b461-4728-9f3e-53ef9c8b9aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee0149cd-b471-4b6a-bb38-e39cc3402404', 'volume_name': 'volume-ee0149cd-b471-4b6a-bb38-e39cc3402404', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ebfc80-f6b5-4a76-bf90-4717c860a193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ebfc80-f6b5-4a76-bf90-4717c860a193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:47 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d1c29b2-fb9d-4c94-8377-f406e87ffca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:47 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] Volume ee0149cd-b471-4b6a-bb38-e39cc3402404: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee0149cd-b471-4b6a-bb38-e39cc3402404', 'volume_size': 1} Jul 21 02:25:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-cc754054-0a18-4277-bff9-e7a7e54f1076 tempest-ProjectMemberTests-723363327 None] Lock "cinder-90bd524d-df6a-48bd-8a73-16b06020b88e-delete_snapshot" released by "delete_snapshot" :: held 2.330s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-36d01f30-f22a-4702-8645-7a95d217946e tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-e4257003-568e-4e95-8b7d-e069570d9c03-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-36d01f30-f22a-4702-8645-7a95d217946e tempest-ProjectMemberTests-723363327 None] Lock "cinder-e4257003-568e-4e95-8b7d-e069570d9c03-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-36d01f30-f22a-4702-8645-7a95d217946e tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-quobyte-e4257003-568e-4e95-8b7d-e069570d9c03" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-36d01f30-f22a-4702-8645-7a95d217946e tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-e4257003-568e-4e95-8b7d-e069570d9c03" acquired by "delete_volume" :: waited 0.017s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:47 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1ab5bb-c5fe-45a7-b636-de96e7b081ce]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-36d01f30-f22a-4702-8645-7a95d217946e tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:47 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-963e249c-54ef-4f11-9235-182e43dcbe6f tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b.b84666e0-6e62-434e-9dcd-28ff54cde832 1G" returned: 0 in 0.683s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-963e249c-54ef-4f11-9235-182e43dcbe6f tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-038c6bdb-a49e-48d6-9f20-78762afc008b -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b.b84666e0-6e62-434e-9dcd-28ff54cde832 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:47 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-038c6bdb-a49e-48d6-9f20-78762afc008b -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b.b84666e0-6e62-434e-9dcd-28ff54cde832 Jul 21 02:25:47 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03 Jul 21 02:25:47 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:47 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:48 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-36d01f30-f22a-4702-8645-7a95d217946e tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03" returned: 0 in 0.393s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-36d01f30-f22a-4702-8645-7a95d217946e tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:48 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-963e249c-54ef-4f11-9235-182e43dcbe6f tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-038c6bdb-a49e-48d6-9f20-78762afc008b -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b.b84666e0-6e62-434e-9dcd-28ff54cde832" returned: 0 in 0.323s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:48 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-963e249c-54ef-4f11-9235-182e43dcbe6f tempest-ProjectReaderTests-1799797276 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b.b84666e0-6e62-434e-9dcd-28ff54cde832 is being set with open permissions: ugo+rw Jul 21 02:25:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-963e249c-54ef-4f11-9235-182e43dcbe6f tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b.b84666e0-6e62-434e-9dcd-28ff54cde832 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:48 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03 Jul 21 02:25:48 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:48 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b.b84666e0-6e62-434e-9dcd-28ff54cde832 Jul 21 02:25:48 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:48 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-36d01f30-f22a-4702-8645-7a95d217946e tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-e4257003-568e-4e95-8b7d-e069570d9c03" returned: 0 in 0.259s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:48 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-36d01f30-f22a-4702-8645-7a95d217946e tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-e4257003-568e-4e95-8b7d-e069570d9c03" released by "delete_volume" :: held 0.720s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:48 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-963e249c-54ef-4f11-9235-182e43dcbe6f tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b.b84666e0-6e62-434e-9dcd-28ff54cde832" returned: 0 in 0.272s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-963e249c-54ef-4f11-9235-182e43dcbe6f tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:48 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b.info Jul 21 02:25:48 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:48 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-36d01f30-f22a-4702-8645-7a95d217946e tempest-ProjectMemberTests-723363327 None] Created reservations ['f6de986f-36d6-4b08-87ba-15895f98a226', 'cb01717a-8d2e-4620-9cd8-c62c891eae7d', '927e8a5e-971a-4e44-92dc-2ebad7e04311', '2f49cd70-9670-4878-8678-2570c4ebdeb5'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-36d01f30-f22a-4702-8645-7a95d217946e tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-36d01f30-f22a-4702-8645-7a95d217946e tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-36d01f30-f22a-4702-8645-7a95d217946e tempest-ProjectMemberTests-723363327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-36d01f30-f22a-4702-8645-7a95d217946e tempest-ProjectMemberTests-723363327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-36d01f30-f22a-4702-8645-7a95d217946e tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-36d01f30-f22a-4702-8645-7a95d217946e tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:48 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:25:48 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:48 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-963e249c-54ef-4f11-9235-182e43dcbe6f tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b.info" returned: 0 in 0.292s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:48 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-963e249c-54ef-4f11-9235-182e43dcbe6f tempest-ProjectReaderTests-1799797276 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b.info is being set with open permissions: ugo+rw Jul 21 02:25:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-963e249c-54ef-4f11-9235-182e43dcbe6f tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:48 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b.info Jul 21 02:25:48 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:48 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:48 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:25:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-36d01f30-f22a-4702-8645-7a95d217946e tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.334s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:48 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-36d01f30-f22a-4702-8645-7a95d217946e tempest-ProjectMemberTests-723363327 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:25:48 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-36d01f30-f22a-4702-8645-7a95d217946e tempest-ProjectMemberTests-723363327 None] Deleted volume successfully. Jul 21 02:25:48 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:25:48 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:48 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-36d01f30-f22a-4702-8645-7a95d217946e tempest-ProjectMemberTests-723363327 None] Lock "cinder-e4257003-568e-4e95-8b7d-e069570d9c03-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:49 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-963e249c-54ef-4f11-9235-182e43dcbe6f tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b.info" returned: 0 in 0.435s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-963e249c-54ef-4f11-9235-182e43dcbe6f tempest-ProjectReaderTests-1799797276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.636s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.611s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-601495639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0149cd-b471-4b6a-bb38-e39cc3402404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0821ad9feafe4fe7a545ff1c0ad1ab25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:47Z,use_quota=True,user_id='c6f0983d3ab4498cb3fc0f0f4b3c0ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] Creating volume ee0149cd-b471-4b6a-bb38-e39cc3402404 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:25:49 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ee0149cd-b471-4b6a-bb38-e39cc3402404 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:49 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ee0149cd-b471-4b6a-bb38-e39cc3402404 1073741824 Jul 21 02:25:49 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:49 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-963e249c-54ef-4f11-9235-182e43dcbe6f tempest-ProjectReaderTests-1799797276 None] Create snapshot completed successfully Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:25:49 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] Flow 'volume_create_manager' (5f8c73be-c4e8-4a66-921c-fd9378561644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00c7fc47-4e7b-4616-976a-cc6bba25ecb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.482s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager._thread_info {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread count: 28 {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread info: [<_MainThread(MainThread, started 135786703114368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00c7fc47-4e7b-4616-976a-cc6bba25ecb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1826438552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9180fe803c342ad96c373b69434c36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:49Z,use_quota=True,user_id='33a1095c5e17461e8e8a710d76a95247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee4d8f8e-0a75-4dd9-888e-5e9d095426bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee4d8f8e-0a75-4dd9-888e-5e9d095426bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d44cd97-f65c-431a-b6b9-b82689ebe45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d44cd97-f65c-431a-b6b9-b82689ebe45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af', 'volume_name': 'volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28715dbb-af5f-46de-abb3-9182008aac4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28715dbb-af5f-46de-abb3-9182008aac4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0523cc96-512f-4d46-afe1-09f1e8eab62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:49 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] Volume fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af', 'volume_size': 1} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:49 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ee0149cd-b471-4b6a-bb38-e39cc3402404 1073741824" returned: 0 in 0.548s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ee0149cd-b471-4b6a-bb38-e39cc3402404 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-79f0822e-995f-4c7a-ae27-418d575ebd5f tempest-ProjectReaderTests-1799797276 None] Acquiring lock "cinder-b84666e0-6e62-434e-9dcd-28ff54cde832-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:49 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ee0149cd-b471-4b6a-bb38-e39cc3402404 Jul 21 02:25:49 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-79f0822e-995f-4c7a-ae27-418d575ebd5f tempest-ProjectReaderTests-1799797276 None] Lock "cinder-b84666e0-6e62-434e-9dcd-28ff54cde832-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-79f0822e-995f-4c7a-ae27-418d575ebd5f tempest-ProjectReaderTests-1799797276 None] Acquiring lock "cinder-quobyte-038c6bdb-a49e-48d6-9f20-78762afc008b" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-79f0822e-995f-4c7a-ae27-418d575ebd5f tempest-ProjectReaderTests-1799797276 None] Lock "cinder-quobyte-038c6bdb-a49e-48d6-9f20-78762afc008b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-79f0822e-995f-4c7a-ae27-418d575ebd5f tempest-ProjectReaderTests-1799797276 None] Acquiring lock "cinder-quobyte-b84666e0-6e62-434e-9dcd-28ff54cde832" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-79f0822e-995f-4c7a-ae27-418d575ebd5f tempest-ProjectReaderTests-1799797276 None] Lock "cinder-quobyte-b84666e0-6e62-434e-9dcd-28ff54cde832" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-79f0822e-995f-4c7a-ae27-418d575ebd5f tempest-ProjectReaderTests-1799797276 None] Deleting offline snapshot b84666e0-6e62-434e-9dcd-28ff54cde832 of volume 038c6bdb-a49e-48d6-9f20-78762afc008b {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-79f0822e-995f-4c7a-ae27-418d575ebd5f tempest-ProjectReaderTests-1799797276 None] snapshot_file for this snap is: volume-038c6bdb-a49e-48d6-9f20-78762afc008b.b84666e0-6e62-434e-9dcd-28ff54cde832 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ec7411-b214-44f5-9a63-4e4d60e58ceb]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-79f0822e-995f-4c7a-ae27-418d575ebd5f tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b.b84666e0-6e62-434e-9dcd-28ff54cde832 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:50 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b.b84666e0-6e62-434e-9dcd-28ff54cde832 Jul 21 02:25:50 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:50 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ee0149cd-b471-4b6a-bb38-e39cc3402404" returned: 0 in 0.286s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:25:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.670s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1826438552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9180fe803c342ad96c373b69434c36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:49Z,use_quota=True,user_id='33a1095c5e17461e8e8a710d76a95247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:25:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] Creating volume fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:25:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:25:50 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:25:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:50 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af 1073741824 Jul 21 02:25:50 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:50 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d1c29b2-fb9d-4c94-8377-f406e87ffca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee0149cd-b471-4b6a-bb38-e39cc3402404', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:50 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bfd4113-3e2d-4997-a366-a28b7230c034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:50 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] Volume volume-ee0149cd-b471-4b6a-bb38-e39cc3402404 (ee0149cd-b471-4b6a-bb38-e39cc3402404): created successfully Jul 21 02:25:50 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bfd4113-3e2d-4997-a366-a28b7230c034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:50 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] Flow 'volume_create_manager' (38f5b299-9076-4fb2-8afd-89063b702e8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:50 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-8a623f6a-5e30-481d-a8b3-bffde98113f4 tempest-ProjectReaderTests-645212503 None] Created volume successfully. Jul 21 02:25:50 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-79f0822e-995f-4c7a-ae27-418d575ebd5f tempest-ProjectReaderTests-1799797276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b.b84666e0-6e62-434e-9dcd-28ff54cde832" returned: 0 in 0.462s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-79f0822e-995f-4c7a-ae27-418d575ebd5f tempest-ProjectReaderTests-1799797276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-038c6bdb-a49e-48d6-9f20-78762afc008b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:25:50 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[5291dd43-606c-4f27-88ae-f90b24a5d600]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-79f0822e-995f-4c7a-ae27-418d575ebd5f tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:50 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b Jul 21 02:25:50 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:50 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af 1073741824" returned: 0 in 0.554s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-55ee7c15-dc92-4b64-8fae-632a1c95b87b tempest-ProjectReaderTests-645212503 None] Acquiring lock "cinder-ee0149cd-b471-4b6a-bb38-e39cc3402404-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-55ee7c15-dc92-4b64-8fae-632a1c95b87b tempest-ProjectReaderTests-645212503 None] Lock "cinder-ee0149cd-b471-4b6a-bb38-e39cc3402404-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:50 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af Jul 21 02:25:50 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-55ee7c15-dc92-4b64-8fae-632a1c95b87b tempest-ProjectReaderTests-645212503 None] Acquiring lock "cinder-quobyte-ee0149cd-b471-4b6a-bb38-e39cc3402404" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-55ee7c15-dc92-4b64-8fae-632a1c95b87b tempest-ProjectReaderTests-645212503 None] Lock "cinder-quobyte-ee0149cd-b471-4b6a-bb38-e39cc3402404" acquired by "delete_volume" :: waited 0.023s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:50 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[37873f54-6f27-4284-aa37-99c05c30ac54]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-55ee7c15-dc92-4b64-8fae-632a1c95b87b tempest-ProjectReaderTests-645212503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ee0149cd-b471-4b6a-bb38-e39cc3402404 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:50 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-79f0822e-995f-4c7a-ae27-418d575ebd5f tempest-ProjectReaderTests-1799797276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b" returned: 0 in 0.501s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-79f0822e-995f-4c7a-ae27-418d575ebd5f tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b.b84666e0-6e62-434e-9dcd-28ff54cde832 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:50 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b.b84666e0-6e62-434e-9dcd-28ff54cde832 Jul 21 02:25:51 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ee0149cd-b471-4b6a-bb38-e39cc3402404 Jul 21 02:25:51 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:51 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:51 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af" returned: 0 in 0.327s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:51 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:25:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0523cc96-512f-4d46-afe1-09f1e8eab62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffaf4bae-ac92-4e34-9dc1-ba968e403f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:51 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] Volume volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af (fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af): created successfully Jul 21 02:25:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffaf4bae-ac92-4e34-9dc1-ba968e403f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] Flow 'volume_create_manager' (5f8c73be-c4e8-4a66-921c-fd9378561644) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:51 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-b506f2db-8e68-4852-a30b-c52857a7f096 tempest-ProjectMemberTests-723363327 None] Created volume successfully. Jul 21 02:25:51 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-55ee7c15-dc92-4b64-8fae-632a1c95b87b tempest-ProjectReaderTests-645212503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ee0149cd-b471-4b6a-bb38-e39cc3402404" returned: 0 in 0.499s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-55ee7c15-dc92-4b64-8fae-632a1c95b87b tempest-ProjectReaderTests-645212503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ee0149cd-b471-4b6a-bb38-e39cc3402404 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:51 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ee0149cd-b471-4b6a-bb38-e39cc3402404 Jul 21 02:25:51 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:51 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-79f0822e-995f-4c7a-ae27-418d575ebd5f tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b.b84666e0-6e62-434e-9dcd-28ff54cde832" returned: 0 in 0.458s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-79f0822e-995f-4c7a-ae27-418d575ebd5f tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b.b84666e0-6e62-434e-9dcd-28ff54cde832 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:51 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b.b84666e0-6e62-434e-9dcd-28ff54cde832 Jul 21 02:25:51 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c7aec198-734c-4d02-825d-c2701b1ec13f tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c7aec198-734c-4d02-825d-c2701b1ec13f tempest-ProjectMemberTests-723363327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:51 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-c7aec198-734c-4d02-825d-c2701b1ec13f tempest-ProjectMemberTests-723363327 None] Creating offline snapshot e4ab86f7-399d-4517-9a07-e6e4a73600f9 of volume fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:25:51 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-55ee7c15-dc92-4b64-8fae-632a1c95b87b tempest-ProjectReaderTests-645212503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-ee0149cd-b471-4b6a-bb38-e39cc3402404" returned: 0 in 0.332s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:51 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-55ee7c15-dc92-4b64-8fae-632a1c95b87b tempest-ProjectReaderTests-645212503 None] Lock "cinder-quobyte-ee0149cd-b471-4b6a-bb38-e39cc3402404" released by "delete_volume" :: held 0.882s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:51 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f4fc31-d968-434b-8962-0d7e8083ceb5]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c7aec198-734c-4d02-825d-c2701b1ec13f tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:51 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-79f0822e-995f-4c7a-ae27-418d575ebd5f tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b.b84666e0-6e62-434e-9dcd-28ff54cde832" returned: 0 in 0.350s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:51 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-79f0822e-995f-4c7a-ae27-418d575ebd5f tempest-ProjectReaderTests-1799797276 None] Lock "cinder-quobyte-b84666e0-6e62-434e-9dcd-28ff54cde832" released by "_delete_snapshot" :: held 1.908s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:51 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-79f0822e-995f-4c7a-ae27-418d575ebd5f tempest-ProjectReaderTests-1799797276 None] Lock "cinder-quobyte-038c6bdb-a49e-48d6-9f20-78762afc008b" released by "delete_snapshot" :: held 1.939s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:51 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-55ee7c15-dc92-4b64-8fae-632a1c95b87b tempest-ProjectReaderTests-645212503 None] Created reservations ['dec27f4f-6f01-4597-ae93-bbb69549fdc0', 'a88a8c46-46d6-4a79-a3b2-78cd62555bc8', 'd79fdd9f-6d21-4482-ac50-58a2628ac688', '7e9ab59c-1319-4ab1-81ef-4eace47c9b90'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:51 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af Jul 21 02:25:51 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-55ee7c15-dc92-4b64-8fae-632a1c95b87b tempest-ProjectReaderTests-645212503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-55ee7c15-dc92-4b64-8fae-632a1c95b87b tempest-ProjectReaderTests-645212503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:51 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-55ee7c15-dc92-4b64-8fae-632a1c95b87b tempest-ProjectReaderTests-645212503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:51 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-55ee7c15-dc92-4b64-8fae-632a1c95b87b tempest-ProjectReaderTests-645212503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-55ee7c15-dc92-4b64-8fae-632a1c95b87b tempest-ProjectReaderTests-645212503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-55ee7c15-dc92-4b64-8fae-632a1c95b87b tempest-ProjectReaderTests-645212503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:51 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-79f0822e-995f-4c7a-ae27-418d575ebd5f tempest-ProjectReaderTests-1799797276 None] Created reservations ['03b7a0d1-3392-439f-874b-629d9505e8ec', '1ddaf368-cf0f-4b0a-8e4e-8104e7411674', '56646a79-60a9-49eb-98d3-3ace67adcefb', '92de9aac-de4b-4cf2-aaa3-98100d56cb9f'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:51 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:25:51 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:52 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-79f0822e-995f-4c7a-ae27-418d575ebd5f tempest-ProjectReaderTests-1799797276 None] Delete snapshot completed successfully. Jul 21 02:25:52 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-79f0822e-995f-4c7a-ae27-418d575ebd5f tempest-ProjectReaderTests-1799797276 None] Lock "cinder-b84666e0-6e62-434e-9dcd-28ff54cde832-delete_snapshot" released by "delete_snapshot" :: held 2.188s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:52 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c7aec198-734c-4d02-825d-c2701b1ec13f tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af" returned: 0 in 0.421s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c7aec198-734c-4d02-825d-c2701b1ec13f tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af.e4ab86f7-399d-4517-9a07-e6e4a73600f9 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:52 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af.e4ab86f7-399d-4517-9a07-e6e4a73600f9 1G Jul 21 02:25:52 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:52 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-55ee7c15-dc92-4b64-8fae-632a1c95b87b tempest-ProjectReaderTests-645212503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.294s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:52 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-55ee7c15-dc92-4b64-8fae-632a1c95b87b tempest-ProjectReaderTests-645212503 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:25:52 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-55ee7c15-dc92-4b64-8fae-632a1c95b87b tempest-ProjectReaderTests-645212503 None] Deleted volume successfully. Jul 21 02:25:52 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-55ee7c15-dc92-4b64-8fae-632a1c95b87b tempest-ProjectReaderTests-645212503 None] Lock "cinder-ee0149cd-b471-4b6a-bb38-e39cc3402404-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:52 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c7aec198-734c-4d02-825d-c2701b1ec13f tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af.e4ab86f7-399d-4517-9a07-e6e4a73600f9 1G" returned: 0 in 0.473s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c7aec198-734c-4d02-825d-c2701b1ec13f tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af.e4ab86f7-399d-4517-9a07-e6e4a73600f9 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:52 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af.e4ab86f7-399d-4517-9a07-e6e4a73600f9 Jul 21 02:25:52 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:52 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c7aec198-734c-4d02-825d-c2701b1ec13f tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af.e4ab86f7-399d-4517-9a07-e6e4a73600f9" returned: 0 in 0.367s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:52 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-c7aec198-734c-4d02-825d-c2701b1ec13f tempest-ProjectMemberTests-723363327 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af.e4ab86f7-399d-4517-9a07-e6e4a73600f9 is being set with open permissions: ugo+rw Jul 21 02:25:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c7aec198-734c-4d02-825d-c2701b1ec13f tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af.e4ab86f7-399d-4517-9a07-e6e4a73600f9 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:53 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af.e4ab86f7-399d-4517-9a07-e6e4a73600f9 Jul 21 02:25:53 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:53 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-087a43c5-d06d-4d33-a1e6-7ad777036303 tempest-ProjectReaderTests-1799797276 None] Acquiring lock "cinder-038c6bdb-a49e-48d6-9f20-78762afc008b-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:53 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-087a43c5-d06d-4d33-a1e6-7ad777036303 tempest-ProjectReaderTests-1799797276 None] Lock "cinder-038c6bdb-a49e-48d6-9f20-78762afc008b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:53 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-087a43c5-d06d-4d33-a1e6-7ad777036303 tempest-ProjectReaderTests-1799797276 None] Acquiring lock "cinder-quobyte-038c6bdb-a49e-48d6-9f20-78762afc008b" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:53 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-087a43c5-d06d-4d33-a1e6-7ad777036303 tempest-ProjectReaderTests-1799797276 None] Lock "cinder-quobyte-038c6bdb-a49e-48d6-9f20-78762afc008b" acquired by "delete_volume" :: waited 0.022s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:53 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb86c0c-0fe2-4c2a-b2e3-500ef52532bc]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-087a43c5-d06d-4d33-a1e6-7ad777036303 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:53 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c7aec198-734c-4d02-825d-c2701b1ec13f tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af.e4ab86f7-399d-4517-9a07-e6e4a73600f9" returned: 0 in 0.383s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c7aec198-734c-4d02-825d-c2701b1ec13f tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:53 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b Jul 21 02:25:53 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:53 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af.info Jul 21 02:25:53 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:53 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c7aec198-734c-4d02-825d-c2701b1ec13f tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af.info" returned: 0 in 0.285s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:53 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-c7aec198-734c-4d02-825d-c2701b1ec13f tempest-ProjectMemberTests-723363327 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af.info is being set with open permissions: ugo+rw Jul 21 02:25:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c7aec198-734c-4d02-825d-c2701b1ec13f tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:53 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af.info Jul 21 02:25:53 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:53 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-087a43c5-d06d-4d33-a1e6-7ad777036303 tempest-ProjectReaderTests-1799797276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b" returned: 0 in 0.521s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-087a43c5-d06d-4d33-a1e6-7ad777036303 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:53 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b Jul 21 02:25:53 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:54 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-c7aec198-734c-4d02-825d-c2701b1ec13f tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af.info" returned: 0 in 0.349s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-c7aec198-734c-4d02-825d-c2701b1ec13f tempest-ProjectMemberTests-723363327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.405s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:54 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-087a43c5-d06d-4d33-a1e6-7ad777036303 tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-038c6bdb-a49e-48d6-9f20-78762afc008b" returned: 0 in 0.317s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-087a43c5-d06d-4d33-a1e6-7ad777036303 tempest-ProjectReaderTests-1799797276 None] Lock "cinder-quobyte-038c6bdb-a49e-48d6-9f20-78762afc008b" released by "delete_volume" :: held 0.991s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:54 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-c7aec198-734c-4d02-825d-c2701b1ec13f tempest-ProjectMemberTests-723363327 None] Create snapshot completed successfully Jul 21 02:25:54 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-087a43c5-d06d-4d33-a1e6-7ad777036303 tempest-ProjectReaderTests-1799797276 None] Created reservations ['64c5fcbe-dda5-4e1e-879b-267beec91fe0', 'ba5baed7-2a8a-44ae-b134-ab24b141da7e', '52517165-a87a-463b-9f5a-6d21b46df6f4', 'e91c1124-08e7-481d-a7a3-b6a852e2d42f'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-087a43c5-d06d-4d33-a1e6-7ad777036303 tempest-ProjectReaderTests-1799797276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-087a43c5-d06d-4d33-a1e6-7ad777036303 tempest-ProjectReaderTests-1799797276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:54 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-087a43c5-d06d-4d33-a1e6-7ad777036303 tempest-ProjectReaderTests-1799797276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:54 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-087a43c5-d06d-4d33-a1e6-7ad777036303 tempest-ProjectReaderTests-1799797276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-087a43c5-d06d-4d33-a1e6-7ad777036303 tempest-ProjectReaderTests-1799797276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-087a43c5-d06d-4d33-a1e6-7ad777036303 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:54 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:25:54 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:54 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-087a43c5-d06d-4d33-a1e6-7ad777036303 tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.299s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:54 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-087a43c5-d06d-4d33-a1e6-7ad777036303 tempest-ProjectReaderTests-1799797276 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:25:54 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-087a43c5-d06d-4d33-a1e6-7ad777036303 tempest-ProjectReaderTests-1799797276 None] Deleted volume successfully. Jul 21 02:25:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-087a43c5-d06d-4d33-a1e6-7ad777036303 tempest-ProjectReaderTests-1799797276 None] Lock "cinder-038c6bdb-a49e-48d6-9f20-78762afc008b-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6a84b818-aa9c-4806-bb29-df1c89fcfd61 tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-e4ab86f7-399d-4517-9a07-e6e4a73600f9-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6a84b818-aa9c-4806-bb29-df1c89fcfd61 tempest-ProjectMemberTests-723363327 None] Lock "cinder-e4ab86f7-399d-4517-9a07-e6e4a73600f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6a84b818-aa9c-4806-bb29-df1c89fcfd61 tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-quobyte-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6a84b818-aa9c-4806-bb29-df1c89fcfd61 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6a84b818-aa9c-4806-bb29-df1c89fcfd61 tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-quobyte-e4ab86f7-399d-4517-9a07-e6e4a73600f9" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:54 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6a84b818-aa9c-4806-bb29-df1c89fcfd61 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-e4ab86f7-399d-4517-9a07-e6e4a73600f9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:54 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-6a84b818-aa9c-4806-bb29-df1c89fcfd61 tempest-ProjectMemberTests-723363327 None] Deleting offline snapshot e4ab86f7-399d-4517-9a07-e6e4a73600f9 of volume fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:25:54 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-6a84b818-aa9c-4806-bb29-df1c89fcfd61 tempest-ProjectMemberTests-723363327 None] snapshot_file for this snap is: volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af.e4ab86f7-399d-4517-9a07-e6e4a73600f9 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:25:54 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[38375e17-e149-47bd-a52b-4ba9f9ea1c05]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6a84b818-aa9c-4806-bb29-df1c89fcfd61 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af.e4ab86f7-399d-4517-9a07-e6e4a73600f9 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:55 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af.e4ab86f7-399d-4517-9a07-e6e4a73600f9 Jul 21 02:25:55 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:55 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6a84b818-aa9c-4806-bb29-df1c89fcfd61 tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af.e4ab86f7-399d-4517-9a07-e6e4a73600f9" returned: 0 in 0.370s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-6a84b818-aa9c-4806-bb29-df1c89fcfd61 tempest-ProjectMemberTests-723363327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:25:55 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57ffaf5-630d-4c70-84cb-9057037e20c2]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6a84b818-aa9c-4806-bb29-df1c89fcfd61 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:55 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af Jul 21 02:25:55 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:55 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6a84b818-aa9c-4806-bb29-df1c89fcfd61 tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af" returned: 0 in 0.411s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6a84b818-aa9c-4806-bb29-df1c89fcfd61 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af.e4ab86f7-399d-4517-9a07-e6e4a73600f9 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:55 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af.e4ab86f7-399d-4517-9a07-e6e4a73600f9 Jul 21 02:25:55 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:55 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:25:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] Flow 'volume_create_manager' (18be519d-e5e0-44ea-9415-faf25838d07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aac71ff-ca91-414c-8874-0e23043d7b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aac71ff-ca91-414c-8874-0e23043d7b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-816785958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2640f930-95a3-4410-8bb1-4aa5289e5a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2b951dc489e4fb2beadcd7e6effef75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:56Z,use_quota=True,user_id='b415ece141044ee59134455fa2c42a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1251d4c8-36e1-4c3d-9e58-f7d5f67aca21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1251d4c8-36e1-4c3d-9e58-f7d5f67aca21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22b2bc62-ec01-4424-8a6f-a286334c8110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22b2bc62-ec01-4424-8a6f-a286334c8110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2640f930-95a3-4410-8bb1-4aa5289e5a28', 'volume_name': 'volume-2640f930-95a3-4410-8bb1-4aa5289e5a28', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0069994d-2b25-4662-8528-0db9849ca356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0069994d-2b25-4662-8528-0db9849ca356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:55 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7370266-e266-4872-9c48-a1710e29f6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:55 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] Volume 2640f930-95a3-4410-8bb1-4aa5289e5a28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2640f930-95a3-4410-8bb1-4aa5289e5a28', 'volume_size': 1} Jul 21 02:25:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-816785958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2640f930-95a3-4410-8bb1-4aa5289e5a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2b951dc489e4fb2beadcd7e6effef75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:56Z,use_quota=True,user_id='b415ece141044ee59134455fa2c42a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:25:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] Creating volume 2640f930-95a3-4410-8bb1-4aa5289e5a28 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:25:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:25:55 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:25:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:56 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28 1073741824 Jul 21 02:25:56 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:56 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6a84b818-aa9c-4806-bb29-df1c89fcfd61 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af.e4ab86f7-399d-4517-9a07-e6e4a73600f9" returned: 0 in 0.414s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6a84b818-aa9c-4806-bb29-df1c89fcfd61 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af.e4ab86f7-399d-4517-9a07-e6e4a73600f9 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:56 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af.e4ab86f7-399d-4517-9a07-e6e4a73600f9 Jul 21 02:25:56 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:56 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6a84b818-aa9c-4806-bb29-df1c89fcfd61 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af.e4ab86f7-399d-4517-9a07-e6e4a73600f9" returned: 0 in 0.288s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:56 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28 1073741824" returned: 0 in 0.520s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:56 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6a84b818-aa9c-4806-bb29-df1c89fcfd61 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-e4ab86f7-399d-4517-9a07-e6e4a73600f9" released by "_delete_snapshot" :: held 1.616s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:56 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6a84b818-aa9c-4806-bb29-df1c89fcfd61 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af" released by "delete_snapshot" :: held 1.643s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:56 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28 Jul 21 02:25:56 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:56 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-6a84b818-aa9c-4806-bb29-df1c89fcfd61 tempest-ProjectMemberTests-723363327 None] Created reservations ['1051a131-eafe-47c0-9475-2f1fc4de5408', '644a92ba-810c-4f89-9ca6-b0a22744fe06', '74773882-a773-4a3f-be9e-8f11235aa34b', '735a7b3d-472f-44f6-a1a5-6fd48040d5d9'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:56 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-6a84b818-aa9c-4806-bb29-df1c89fcfd61 tempest-ProjectMemberTests-723363327 None] Delete snapshot completed successfully. Jul 21 02:25:56 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6a84b818-aa9c-4806-bb29-df1c89fcfd61 tempest-ProjectMemberTests-723363327 None] Lock "cinder-e4ab86f7-399d-4517-9a07-e6e4a73600f9-delete_snapshot" released by "delete_snapshot" :: held 1.855s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:56 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28" returned: 0 in 0.336s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:56 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:25:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7370266-e266-4872-9c48-a1710e29f6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2640f930-95a3-4410-8bb1-4aa5289e5a28', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2906a157-436d-4a5e-b65b-a6777185ef79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:56 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] Volume volume-2640f930-95a3-4410-8bb1-4aa5289e5a28 (2640f930-95a3-4410-8bb1-4aa5289e5a28): created successfully Jul 21 02:25:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2906a157-436d-4a5e-b65b-a6777185ef79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:56 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] Flow 'volume_create_manager' (18be519d-e5e0-44ea-9415-faf25838d07b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:56 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-66d5bc93-b88a-4374-91dd-40c0d25b7606 tempest-ProjectReaderTests-1799797276 None] Created volume successfully. Jul 21 02:25:57 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-849442fd-f7b9-4117-83ab-a75f30f90a14 tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:57 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-849442fd-f7b9-4117-83ab-a75f30f90a14 tempest-ProjectMemberTests-723363327 None] Lock "cinder-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:57 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-849442fd-f7b9-4117-83ab-a75f30f90a14 tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-quobyte-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:25:57 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-849442fd-f7b9-4117-83ab-a75f30f90a14 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af" acquired by "delete_volume" :: waited 0.018s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:25:57 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[f857d74e-1b33-42a3-8990-c62eef89ee36]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-849442fd-f7b9-4117-83ab-a75f30f90a14 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:57 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af Jul 21 02:25:57 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:57 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-849442fd-f7b9-4117-83ab-a75f30f90a14 tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af" returned: 0 in 0.371s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-849442fd-f7b9-4117-83ab-a75f30f90a14 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:57 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af Jul 21 02:25:57 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:57 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-849442fd-f7b9-4117-83ab-a75f30f90a14 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af" returned: 0 in 0.244s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:57 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-849442fd-f7b9-4117-83ab-a75f30f90a14 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af" released by "delete_volume" :: held 0.686s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:57 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-849442fd-f7b9-4117-83ab-a75f30f90a14 tempest-ProjectMemberTests-723363327 None] Created reservations ['c5732427-9ec3-4c92-853b-24225e107f01', '8c25055c-e957-4af5-85dd-9570181d5210', 'f7921997-d035-491f-8676-f6afc37adce8', '201ed263-d57a-4918-a7c1-2356d334316b'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:25:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-849442fd-f7b9-4117-83ab-a75f30f90a14 tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-849442fd-f7b9-4117-83ab-a75f30f90a14 tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:57 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-849442fd-f7b9-4117-83ab-a75f30f90a14 tempest-ProjectMemberTests-723363327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:25:57 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-849442fd-f7b9-4117-83ab-a75f30f90a14 tempest-ProjectMemberTests-723363327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:25:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-849442fd-f7b9-4117-83ab-a75f30f90a14 tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:25:57 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-849442fd-f7b9-4117-83ab-a75f30f90a14 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:57 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:25:57 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2837c92d-2c1a-4515-a4ab-a33418551df2 tempest-ProjectReaderTests-1799797276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2837c92d-2c1a-4515-a4ab-a33418551df2 tempest-ProjectReaderTests-1799797276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:25:58 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-2837c92d-2c1a-4515-a4ab-a33418551df2 tempest-ProjectReaderTests-1799797276 None] Creating offline snapshot fae7574c-2af5-475e-a5c7-4abf1eb9135b of volume 2640f930-95a3-4410-8bb1-4aa5289e5a28 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:25:58 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f36feae-bd12-4222-8393-514539fc49d4]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:25:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2837c92d-2c1a-4515-a4ab-a33418551df2 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:58 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-849442fd-f7b9-4117-83ab-a75f30f90a14 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.355s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:58 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-849442fd-f7b9-4117-83ab-a75f30f90a14 tempest-ProjectMemberTests-723363327 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:25:58 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-849442fd-f7b9-4117-83ab-a75f30f90a14 tempest-ProjectMemberTests-723363327 None] Deleted volume successfully. Jul 21 02:25:58 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-849442fd-f7b9-4117-83ab-a75f30f90a14 tempest-ProjectMemberTests-723363327 None] Lock "cinder-fc81bb4f-c31e-4b0b-b8fd-e0a4bdf111af-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:25:58 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28 Jul 21 02:25:58 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:58 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2837c92d-2c1a-4515-a4ab-a33418551df2 tempest-ProjectReaderTests-1799797276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28" returned: 0 in 0.684s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:58 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2837c92d-2c1a-4515-a4ab-a33418551df2 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28.fae7574c-2af5-475e-a5c7-4abf1eb9135b 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:58 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28.fae7574c-2af5-475e-a5c7-4abf1eb9135b 1G Jul 21 02:25:58 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:58 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:25:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] Flow 'volume_create_manager' (767f0131-cb65-433d-be1b-92f68ffcab11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:25:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7477442-0d7f-4882-a887-3b00760b5ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7477442-0d7f-4882-a887-3b00760b5ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-736920610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b71aece7-70f5-4223-8527-4d2a5f22c676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9180fe803c342ad96c373b69434c36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:59Z,use_quota=True,user_id='33a1095c5e17461e8e8a710d76a95247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48ad783c-2fa1-444a-9dd5-226a1d69c837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48ad783c-2fa1-444a-9dd5-226a1d69c837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af6d6484-13f1-401a-8108-c79c09a73e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af6d6484-13f1-401a-8108-c79c09a73e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b71aece7-70f5-4223-8527-4d2a5f22c676', 'volume_name': 'volume-b71aece7-70f5-4223-8527-4d2a5f22c676', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0cdb467-6375-492b-bffd-1f601842775e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0cdb467-6375-492b-bffd-1f601842775e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:25:59 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98e51a92-81c7-409d-9947-bbdccf2650a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:25:59 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] Volume b71aece7-70f5-4223-8527-4d2a5f22c676: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b71aece7-70f5-4223-8527-4d2a5f22c676', 'volume_size': 1} Jul 21 02:25:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:25:59 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2837c92d-2c1a-4515-a4ab-a33418551df2 tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28.fae7574c-2af5-475e-a5c7-4abf1eb9135b 1G" returned: 0 in 0.487s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2837c92d-2c1a-4515-a4ab-a33418551df2 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2640f930-95a3-4410-8bb1-4aa5289e5a28 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28.fae7574c-2af5-475e-a5c7-4abf1eb9135b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:59 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2640f930-95a3-4410-8bb1-4aa5289e5a28 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28.fae7574c-2af5-475e-a5c7-4abf1eb9135b Jul 21 02:25:59 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:25:59 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Jul 21 02:25:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2837c92d-2c1a-4515-a4ab-a33418551df2 tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2640f930-95a3-4410-8bb1-4aa5289e5a28 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28.fae7574c-2af5-475e-a5c7-4abf1eb9135b" returned: 0 in 0.431s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:25:59 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-2837c92d-2c1a-4515-a4ab-a33418551df2 tempest-ProjectReaderTests-1799797276 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28.fae7574c-2af5-475e-a5c7-4abf1eb9135b is being set with open permissions: ugo+rw Jul 21 02:25:59 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2837c92d-2c1a-4515-a4ab-a33418551df2 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28.fae7574c-2af5-475e-a5c7-4abf1eb9135b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:25:59 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28.fae7574c-2af5-475e-a5c7-4abf1eb9135b Jul 21 02:25:59 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:00 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2837c92d-2c1a-4515-a4ab-a33418551df2 tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28.fae7574c-2af5-475e-a5c7-4abf1eb9135b" returned: 0 in 0.281s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2837c92d-2c1a-4515-a4ab-a33418551df2 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:00 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28.info Jul 21 02:26:00 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:00 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2837c92d-2c1a-4515-a4ab-a33418551df2 tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28.info" returned: 0 in 0.264s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:00 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-2837c92d-2c1a-4515-a4ab-a33418551df2 tempest-ProjectReaderTests-1799797276 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28.info is being set with open permissions: ugo+rw Jul 21 02:26:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2837c92d-2c1a-4515-a4ab-a33418551df2 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:00 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28.info Jul 21 02:26:00 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:00 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2837c92d-2c1a-4515-a4ab-a33418551df2 tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28.info" returned: 0 in 0.264s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2837c92d-2c1a-4515-a4ab-a33418551df2 tempest-ProjectReaderTests-1799797276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.511s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.643s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:00 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-736920610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b71aece7-70f5-4223-8527-4d2a5f22c676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9180fe803c342ad96c373b69434c36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:25:59Z,use_quota=True,user_id='33a1095c5e17461e8e8a710d76a95247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:26:00 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] Creating volume b71aece7-70f5-4223-8527-4d2a5f22c676 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:26:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:00 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:26:00 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:26:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:00 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:26:00 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:26:00 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:00 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676 1073741824 Jul 21 02:26:00 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:00 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-2837c92d-2c1a-4515-a4ab-a33418551df2 tempest-ProjectReaderTests-1799797276 None] Create snapshot completed successfully Jul 21 02:26:01 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676 1073741824" returned: 0 in 0.478s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:01 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676 Jul 21 02:26:01 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d6458271-84d7-4a8c-a5e4-e3e41877508b tempest-ProjectReaderTests-1799797276 None] Acquiring lock "cinder-fae7574c-2af5-475e-a5c7-4abf1eb9135b-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d6458271-84d7-4a8c-a5e4-e3e41877508b tempest-ProjectReaderTests-1799797276 None] Lock "cinder-fae7574c-2af5-475e-a5c7-4abf1eb9135b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d6458271-84d7-4a8c-a5e4-e3e41877508b tempest-ProjectReaderTests-1799797276 None] Acquiring lock "cinder-quobyte-2640f930-95a3-4410-8bb1-4aa5289e5a28" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d6458271-84d7-4a8c-a5e4-e3e41877508b tempest-ProjectReaderTests-1799797276 None] Lock "cinder-quobyte-2640f930-95a3-4410-8bb1-4aa5289e5a28" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d6458271-84d7-4a8c-a5e4-e3e41877508b tempest-ProjectReaderTests-1799797276 None] Acquiring lock "cinder-quobyte-fae7574c-2af5-475e-a5c7-4abf1eb9135b" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:01 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d6458271-84d7-4a8c-a5e4-e3e41877508b tempest-ProjectReaderTests-1799797276 None] Lock "cinder-quobyte-fae7574c-2af5-475e-a5c7-4abf1eb9135b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:01 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-d6458271-84d7-4a8c-a5e4-e3e41877508b tempest-ProjectReaderTests-1799797276 None] Deleting offline snapshot fae7574c-2af5-475e-a5c7-4abf1eb9135b of volume 2640f930-95a3-4410-8bb1-4aa5289e5a28 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:26:01 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-d6458271-84d7-4a8c-a5e4-e3e41877508b tempest-ProjectReaderTests-1799797276 None] snapshot_file for this snap is: volume-2640f930-95a3-4410-8bb1-4aa5289e5a28.fae7574c-2af5-475e-a5c7-4abf1eb9135b {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:26:01 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676" returned: 0 in 0.302s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:01 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:26:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:01 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d38586-2470-42af-8494-a00279f1accf]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d6458271-84d7-4a8c-a5e4-e3e41877508b tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28.fae7574c-2af5-475e-a5c7-4abf1eb9135b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:01 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98e51a92-81c7-409d-9947-bbdccf2650a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b71aece7-70f5-4223-8527-4d2a5f22c676', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:01 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1b76d4d-b6ce-4a2a-b756-e9cb9ab2a02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:01 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] Volume volume-b71aece7-70f5-4223-8527-4d2a5f22c676 (b71aece7-70f5-4223-8527-4d2a5f22c676): created successfully Jul 21 02:26:01 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1b76d4d-b6ce-4a2a-b756-e9cb9ab2a02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:01 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] Flow 'volume_create_manager' (767f0131-cb65-433d-be1b-92f68ffcab11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:26:01 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-ad303e55-cfa4-4f92-a009-3646576d30b8 tempest-ProjectMemberTests-723363327 None] Created volume successfully. Jul 21 02:26:01 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28.fae7574c-2af5-475e-a5c7-4abf1eb9135b Jul 21 02:26:01 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:01 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d6458271-84d7-4a8c-a5e4-e3e41877508b tempest-ProjectReaderTests-1799797276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28.fae7574c-2af5-475e-a5c7-4abf1eb9135b" returned: 0 in 0.393s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:01 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-d6458271-84d7-4a8c-a5e4-e3e41877508b tempest-ProjectReaderTests-1799797276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2640f930-95a3-4410-8bb1-4aa5289e5a28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:26:01 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b318119-efd4-4fa1-b33b-ca52731f0415]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:01 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d6458271-84d7-4a8c-a5e4-e3e41877508b tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:02 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28 Jul 21 02:26:02 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7fd7e662-3ea4-42a3-92ec-1b3d791fe6f7 tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7fd7e662-3ea4-42a3-92ec-1b3d791fe6f7 tempest-ProjectMemberTests-723363327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:02 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-7fd7e662-3ea4-42a3-92ec-1b3d791fe6f7 tempest-ProjectMemberTests-723363327 None] Creating offline snapshot 0a3e1d49-fced-45cb-bf8d-d12dc3e26099 of volume b71aece7-70f5-4223-8527-4d2a5f22c676 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:26:02 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[00feb7a8-82cc-41e3-a87a-75f48cbdd6c6]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fd7e662-3ea4-42a3-92ec-1b3d791fe6f7 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:02 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d6458271-84d7-4a8c-a5e4-e3e41877508b tempest-ProjectReaderTests-1799797276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28" returned: 0 in 0.430s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d6458271-84d7-4a8c-a5e4-e3e41877508b tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28.fae7574c-2af5-475e-a5c7-4abf1eb9135b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:02 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28.fae7574c-2af5-475e-a5c7-4abf1eb9135b Jul 21 02:26:02 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:02 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676 Jul 21 02:26:02 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:02 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fd7e662-3ea4-42a3-92ec-1b3d791fe6f7 tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676" returned: 0 in 0.421s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fd7e662-3ea4-42a3-92ec-1b3d791fe6f7 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676.0a3e1d49-fced-45cb-bf8d-d12dc3e26099 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:02 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d6458271-84d7-4a8c-a5e4-e3e41877508b tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28.fae7574c-2af5-475e-a5c7-4abf1eb9135b" returned: 0 in 0.392s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:02 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d6458271-84d7-4a8c-a5e4-e3e41877508b tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28.fae7574c-2af5-475e-a5c7-4abf1eb9135b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:02 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676.0a3e1d49-fced-45cb-bf8d-d12dc3e26099 1G Jul 21 02:26:02 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:02 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28.fae7574c-2af5-475e-a5c7-4abf1eb9135b Jul 21 02:26:02 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:03 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d6458271-84d7-4a8c-a5e4-e3e41877508b tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28.fae7574c-2af5-475e-a5c7-4abf1eb9135b" returned: 0 in 0.251s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d6458271-84d7-4a8c-a5e4-e3e41877508b tempest-ProjectReaderTests-1799797276 None] Lock "cinder-quobyte-fae7574c-2af5-475e-a5c7-4abf1eb9135b" released by "_delete_snapshot" :: held 1.599s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d6458271-84d7-4a8c-a5e4-e3e41877508b tempest-ProjectReaderTests-1799797276 None] Lock "cinder-quobyte-2640f930-95a3-4410-8bb1-4aa5289e5a28" released by "delete_snapshot" :: held 1.632s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:03 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-d6458271-84d7-4a8c-a5e4-e3e41877508b tempest-ProjectReaderTests-1799797276 None] Created reservations ['e7a8c0f7-6748-4a79-8818-91f181485ce7', 'ba593bff-bfa7-4d39-921e-faca0d63248d', '96f12124-d6df-4c11-a69d-fae7a856e942', 'd6bf8619-9505-43c4-b37b-fedb6889154f'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:26:03 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-d6458271-84d7-4a8c-a5e4-e3e41877508b tempest-ProjectReaderTests-1799797276 None] Delete snapshot completed successfully. Jul 21 02:26:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d6458271-84d7-4a8c-a5e4-e3e41877508b tempest-ProjectReaderTests-1799797276 None] Lock "cinder-fae7574c-2af5-475e-a5c7-4abf1eb9135b-delete_snapshot" released by "delete_snapshot" :: held 1.812s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:03 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fd7e662-3ea4-42a3-92ec-1b3d791fe6f7 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676.0a3e1d49-fced-45cb-bf8d-d12dc3e26099 1G" returned: 0 in 0.483s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fd7e662-3ea4-42a3-92ec-1b3d791fe6f7 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b71aece7-70f5-4223-8527-4d2a5f22c676 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676.0a3e1d49-fced-45cb-bf8d-d12dc3e26099 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:03 devstack sudo[107764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b71aece7-70f5-4223-8527-4d2a5f22c676 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676.0a3e1d49-fced-45cb-bf8d-d12dc3e26099 Jul 21 02:26:03 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:03 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fd7e662-3ea4-42a3-92ec-1b3d791fe6f7 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b71aece7-70f5-4223-8527-4d2a5f22c676 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676.0a3e1d49-fced-45cb-bf8d-d12dc3e26099" returned: 0 in 0.340s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:03 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-7fd7e662-3ea4-42a3-92ec-1b3d791fe6f7 tempest-ProjectMemberTests-723363327 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676.0a3e1d49-fced-45cb-bf8d-d12dc3e26099 is being set with open permissions: ugo+rw Jul 21 02:26:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fd7e662-3ea4-42a3-92ec-1b3d791fe6f7 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676.0a3e1d49-fced-45cb-bf8d-d12dc3e26099 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-99306aef-d1ea-4ae2-a1a6-33cac98b6c34 tempest-ProjectReaderTests-1799797276 None] Acquiring lock "cinder-2640f930-95a3-4410-8bb1-4aa5289e5a28-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:03 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676.0a3e1d49-fced-45cb-bf8d-d12dc3e26099 Jul 21 02:26:03 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-99306aef-d1ea-4ae2-a1a6-33cac98b6c34 tempest-ProjectReaderTests-1799797276 None] Lock "cinder-2640f930-95a3-4410-8bb1-4aa5289e5a28-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-99306aef-d1ea-4ae2-a1a6-33cac98b6c34 tempest-ProjectReaderTests-1799797276 None] Acquiring lock "cinder-quobyte-2640f930-95a3-4410-8bb1-4aa5289e5a28" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:03 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-99306aef-d1ea-4ae2-a1a6-33cac98b6c34 tempest-ProjectReaderTests-1799797276 None] Lock "cinder-quobyte-2640f930-95a3-4410-8bb1-4aa5289e5a28" acquired by "delete_volume" :: waited 0.016s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:03 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7e2b78-6e74-491c-876d-586a1aa46342]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-99306aef-d1ea-4ae2-a1a6-33cac98b6c34 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:03 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fd7e662-3ea4-42a3-92ec-1b3d791fe6f7 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676.0a3e1d49-fced-45cb-bf8d-d12dc3e26099" returned: 0 in 0.289s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:03 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fd7e662-3ea4-42a3-92ec-1b3d791fe6f7 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:03 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28 Jul 21 02:26:03 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:03 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676.info Jul 21 02:26:03 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:04 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-99306aef-d1ea-4ae2-a1a6-33cac98b6c34 tempest-ProjectReaderTests-1799797276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28" returned: 0 in 0.394s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-99306aef-d1ea-4ae2-a1a6-33cac98b6c34 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:04 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fd7e662-3ea4-42a3-92ec-1b3d791fe6f7 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676.info" returned: 0 in 0.287s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:04 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-7fd7e662-3ea4-42a3-92ec-1b3d791fe6f7 tempest-ProjectMemberTests-723363327 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676.info is being set with open permissions: ugo+rw Jul 21 02:26:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fd7e662-3ea4-42a3-92ec-1b3d791fe6f7 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:04 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28 Jul 21 02:26:04 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:04 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676.info Jul 21 02:26:04 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:04 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-99306aef-d1ea-4ae2-a1a6-33cac98b6c34 tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2640f930-95a3-4410-8bb1-4aa5289e5a28" returned: 0 in 0.282s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:04 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-99306aef-d1ea-4ae2-a1a6-33cac98b6c34 tempest-ProjectReaderTests-1799797276 None] Lock "cinder-quobyte-2640f930-95a3-4410-8bb1-4aa5289e5a28" released by "delete_volume" :: held 0.774s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:04 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7fd7e662-3ea4-42a3-92ec-1b3d791fe6f7 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676.info" returned: 0 in 0.294s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7fd7e662-3ea4-42a3-92ec-1b3d791fe6f7 tempest-ProjectMemberTests-723363327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.217s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:04 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-7fd7e662-3ea4-42a3-92ec-1b3d791fe6f7 tempest-ProjectMemberTests-723363327 None] Create snapshot completed successfully Jul 21 02:26:04 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-99306aef-d1ea-4ae2-a1a6-33cac98b6c34 tempest-ProjectReaderTests-1799797276 None] Created reservations ['03a94a79-b5b0-4bc0-a65e-caea07c5a798', '3fe55a9b-a334-43d2-a084-0de42a0b9068', 'f86ca189-2a2d-4712-9f0d-5bf4426fa018', '5b117248-f4dc-4da8-bd54-4129a3eede68'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:26:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-99306aef-d1ea-4ae2-a1a6-33cac98b6c34 tempest-ProjectReaderTests-1799797276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-99306aef-d1ea-4ae2-a1a6-33cac98b6c34 tempest-ProjectReaderTests-1799797276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:04 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-99306aef-d1ea-4ae2-a1a6-33cac98b6c34 tempest-ProjectReaderTests-1799797276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:26:04 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-99306aef-d1ea-4ae2-a1a6-33cac98b6c34 tempest-ProjectReaderTests-1799797276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:26:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-99306aef-d1ea-4ae2-a1a6-33cac98b6c34 tempest-ProjectReaderTests-1799797276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-99306aef-d1ea-4ae2-a1a6-33cac98b6c34 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:04 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:26:04 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:04 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:04 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-99306aef-d1ea-4ae2-a1a6-33cac98b6c34 tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.277s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:04 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-99306aef-d1ea-4ae2-a1a6-33cac98b6c34 tempest-ProjectReaderTests-1799797276 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:26:04 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-99306aef-d1ea-4ae2-a1a6-33cac98b6c34 tempest-ProjectReaderTests-1799797276 None] Deleted volume successfully. Jul 21 02:26:04 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-99306aef-d1ea-4ae2-a1a6-33cac98b6c34 tempest-ProjectReaderTests-1799797276 None] Lock "cinder-2640f930-95a3-4410-8bb1-4aa5289e5a28-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:05 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:26:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] Flow 'volume_create_manager' (363488b8-3ff8-4b13-b9cd-efe03d9175c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:26:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a84756b7-0355-428d-874b-42d9d158a675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a84756b7-0355-428d-874b-42d9d158a675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-82847748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2b951dc489e4fb2beadcd7e6effef75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:26:05Z,use_quota=True,user_id='b415ece141044ee59134455fa2c42a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddbed60a-e559-4a62-87b6-0ed072414a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddbed60a-e559-4a62-87b6-0ed072414a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6098ac40-3956-4df2-ada9-ce94c161a333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6098ac40-3956-4df2-ada9-ce94c161a333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94', 'volume_name': 'volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9192b288-6658-4b8e-91ea-67a7a827fcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9192b288-6658-4b8e-91ea-67a7a827fcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:05 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d4d3b0-8308-414c-ba99-b4d501b8ddc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:05 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] Volume fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94', 'volume_size': 1} Jul 21 02:26:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-82847748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2b951dc489e4fb2beadcd7e6effef75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:26:05Z,use_quota=True,user_id='b415ece141044ee59134455fa2c42a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:26:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] Creating volume fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:26:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:26:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:26:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:26:05 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:26:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:05 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94 1073741824 Jul 21 02:26:05 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:05 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3942751f-dd1b-4b64-b611-c33a9d42e735 tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-0a3e1d49-fced-45cb-bf8d-d12dc3e26099-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:05 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3942751f-dd1b-4b64-b611-c33a9d42e735 tempest-ProjectMemberTests-723363327 None] Lock "cinder-0a3e1d49-fced-45cb-bf8d-d12dc3e26099-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:05 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3942751f-dd1b-4b64-b611-c33a9d42e735 tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-quobyte-b71aece7-70f5-4223-8527-4d2a5f22c676" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:05 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3942751f-dd1b-4b64-b611-c33a9d42e735 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-b71aece7-70f5-4223-8527-4d2a5f22c676" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:05 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3942751f-dd1b-4b64-b611-c33a9d42e735 tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-quobyte-0a3e1d49-fced-45cb-bf8d-d12dc3e26099" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:05 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3942751f-dd1b-4b64-b611-c33a9d42e735 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-0a3e1d49-fced-45cb-bf8d-d12dc3e26099" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-3942751f-dd1b-4b64-b611-c33a9d42e735 tempest-ProjectMemberTests-723363327 None] Deleting offline snapshot 0a3e1d49-fced-45cb-bf8d-d12dc3e26099 of volume b71aece7-70f5-4223-8527-4d2a5f22c676 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:26:05 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-3942751f-dd1b-4b64-b611-c33a9d42e735 tempest-ProjectMemberTests-723363327 None] snapshot_file for this snap is: volume-b71aece7-70f5-4223-8527-4d2a5f22c676.0a3e1d49-fced-45cb-bf8d-d12dc3e26099 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:26:05 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc62a78-8573-4f10-ba1f-c96ceebd4490]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:05 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3942751f-dd1b-4b64-b611-c33a9d42e735 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676.0a3e1d49-fced-45cb-bf8d-d12dc3e26099 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:05 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676.0a3e1d49-fced-45cb-bf8d-d12dc3e26099 Jul 21 02:26:05 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:06 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94 1073741824" returned: 0 in 0.559s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:06 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94 Jul 21 02:26:06 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:06 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3942751f-dd1b-4b64-b611-c33a9d42e735 tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676.0a3e1d49-fced-45cb-bf8d-d12dc3e26099" returned: 0 in 0.410s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:06 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-3942751f-dd1b-4b64-b611-c33a9d42e735 tempest-ProjectMemberTests-723363327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b71aece7-70f5-4223-8527-4d2a5f22c676(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:26:06 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[b515d263-5058-4905-96a3-e8812ed0b6a7]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3942751f-dd1b-4b64-b611-c33a9d42e735 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:06 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676 Jul 21 02:26:06 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:06 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94" returned: 0 in 0.273s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:06 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:26:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d4d3b0-8308-414c-ba99-b4d501b8ddc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (640b98bc-3e29-493a-b806-8266eadd4742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:06 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] Volume volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94 (fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94): created successfully Jul 21 02:26:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (640b98bc-3e29-493a-b806-8266eadd4742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:06 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] Flow 'volume_create_manager' (363488b8-3ff8-4b13-b9cd-efe03d9175c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:26:06 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-609e0cb9-a38d-4e5c-bacc-493820565c9d tempest-ProjectReaderTests-1799797276 None] Created volume successfully. Jul 21 02:26:06 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3942751f-dd1b-4b64-b611-c33a9d42e735 tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676" returned: 0 in 0.372s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3942751f-dd1b-4b64-b611-c33a9d42e735 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676.0a3e1d49-fced-45cb-bf8d-d12dc3e26099 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:06 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676.0a3e1d49-fced-45cb-bf8d-d12dc3e26099 Jul 21 02:26:06 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:06 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3942751f-dd1b-4b64-b611-c33a9d42e735 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676.0a3e1d49-fced-45cb-bf8d-d12dc3e26099" returned: 0 in 0.369s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:06 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3942751f-dd1b-4b64-b611-c33a9d42e735 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676.0a3e1d49-fced-45cb-bf8d-d12dc3e26099 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:06 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676.0a3e1d49-fced-45cb-bf8d-d12dc3e26099 Jul 21 02:26:06 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:07 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3942751f-dd1b-4b64-b611-c33a9d42e735 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676.0a3e1d49-fced-45cb-bf8d-d12dc3e26099" returned: 0 in 0.253s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:07 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3942751f-dd1b-4b64-b611-c33a9d42e735 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-0a3e1d49-fced-45cb-bf8d-d12dc3e26099" released by "_delete_snapshot" :: held 1.531s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:07 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3942751f-dd1b-4b64-b611-c33a9d42e735 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-b71aece7-70f5-4223-8527-4d2a5f22c676" released by "delete_snapshot" :: held 1.558s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:07 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-3942751f-dd1b-4b64-b611-c33a9d42e735 tempest-ProjectMemberTests-723363327 None] Created reservations ['907aa9e1-9e6f-400b-8316-99da2da91409', '45ade51e-242e-48e4-a977-fb9e132efc3c', 'ec4ac78b-0388-406b-92b0-1a9702130f34', '0bfbe41a-3f11-470a-957a-6565f8a12c65'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:26:07 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-3942751f-dd1b-4b64-b611-c33a9d42e735 tempest-ProjectMemberTests-723363327 None] Delete snapshot completed successfully. Jul 21 02:26:07 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3942751f-dd1b-4b64-b611-c33a9d42e735 tempest-ProjectMemberTests-723363327 None] Lock "cinder-0a3e1d49-fced-45cb-bf8d-d12dc3e26099-delete_snapshot" released by "delete_snapshot" :: held 1.723s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f05842e1-865b-4b9c-9314-2e67a1680e50 tempest-ProjectReaderTests-1799797276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f05842e1-865b-4b9c-9314-2e67a1680e50 tempest-ProjectReaderTests-1799797276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:07 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-f05842e1-865b-4b9c-9314-2e67a1680e50 tempest-ProjectReaderTests-1799797276 None] Creating offline snapshot ab147ef6-ba69-4517-a72e-ef008ada7d32 of volume fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:26:07 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[7600c0ef-9c29-41b1-86e3-3b7481e78f5b]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f05842e1-865b-4b9c-9314-2e67a1680e50 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:07 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ecf802b3-c36c-4294-9d82-86f82d304509 tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-b71aece7-70f5-4223-8527-4d2a5f22c676-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:07 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94 Jul 21 02:26:07 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:07 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ecf802b3-c36c-4294-9d82-86f82d304509 tempest-ProjectMemberTests-723363327 None] Lock "cinder-b71aece7-70f5-4223-8527-4d2a5f22c676-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:07 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ecf802b3-c36c-4294-9d82-86f82d304509 tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-quobyte-b71aece7-70f5-4223-8527-4d2a5f22c676" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:07 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ecf802b3-c36c-4294-9d82-86f82d304509 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-b71aece7-70f5-4223-8527-4d2a5f22c676" acquired by "delete_volume" :: waited 0.022s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:07 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61e5db7-21c7-48a0-bc1d-7e44ab3bd487]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:07 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ecf802b3-c36c-4294-9d82-86f82d304509 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:08 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676 Jul 21 02:26:08 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:08 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f05842e1-865b-4b9c-9314-2e67a1680e50 tempest-ProjectReaderTests-1799797276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94" returned: 0 in 0.504s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f05842e1-865b-4b9c-9314-2e67a1680e50 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94.ab147ef6-ba69-4517-a72e-ef008ada7d32 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:08 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94.ab147ef6-ba69-4517-a72e-ef008ada7d32 1G Jul 21 02:26:08 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:08 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ecf802b3-c36c-4294-9d82-86f82d304509 tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676" returned: 0 in 0.498s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ecf802b3-c36c-4294-9d82-86f82d304509 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:08 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676 Jul 21 02:26:08 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:08 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f05842e1-865b-4b9c-9314-2e67a1680e50 tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94.ab147ef6-ba69-4517-a72e-ef008ada7d32 1G" returned: 0 in 0.501s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f05842e1-865b-4b9c-9314-2e67a1680e50 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94.ab147ef6-ba69-4517-a72e-ef008ada7d32 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:08 devstack sudo[107842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94.ab147ef6-ba69-4517-a72e-ef008ada7d32 Jul 21 02:26:08 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:08 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ecf802b3-c36c-4294-9d82-86f82d304509 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-b71aece7-70f5-4223-8527-4d2a5f22c676" returned: 0 in 0.311s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:08 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ecf802b3-c36c-4294-9d82-86f82d304509 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-b71aece7-70f5-4223-8527-4d2a5f22c676" released by "delete_volume" :: held 0.892s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:08 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-ecf802b3-c36c-4294-9d82-86f82d304509 tempest-ProjectMemberTests-723363327 None] Created reservations ['017237cf-3848-471e-88f1-db07109655c5', 'e48caabf-c5bc-44d8-9be1-95b4eb91da2b', '174e5d22-bc43-4542-bd5d-460ca8c9af12', '97eec0ba-a674-497a-a123-d0b31aea1d5c'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:26:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ecf802b3-c36c-4294-9d82-86f82d304509 tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ecf802b3-c36c-4294-9d82-86f82d304509 tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ecf802b3-c36c-4294-9d82-86f82d304509 tempest-ProjectMemberTests-723363327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:26:08 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ecf802b3-c36c-4294-9d82-86f82d304509 tempest-ProjectMemberTests-723363327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:26:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ecf802b3-c36c-4294-9d82-86f82d304509 tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:08 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ecf802b3-c36c-4294-9d82-86f82d304509 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:08 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:26:08 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:09 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f05842e1-865b-4b9c-9314-2e67a1680e50 tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94.ab147ef6-ba69-4517-a72e-ef008ada7d32" returned: 0 in 0.356s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:09 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-f05842e1-865b-4b9c-9314-2e67a1680e50 tempest-ProjectReaderTests-1799797276 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94.ab147ef6-ba69-4517-a72e-ef008ada7d32 is being set with open permissions: ugo+rw Jul 21 02:26:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f05842e1-865b-4b9c-9314-2e67a1680e50 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94.ab147ef6-ba69-4517-a72e-ef008ada7d32 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:09 devstack sudo[107850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94.ab147ef6-ba69-4517-a72e-ef008ada7d32 Jul 21 02:26:09 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:09 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ecf802b3-c36c-4294-9d82-86f82d304509 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.397s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:09 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-ecf802b3-c36c-4294-9d82-86f82d304509 tempest-ProjectMemberTests-723363327 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:26:09 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-ecf802b3-c36c-4294-9d82-86f82d304509 tempest-ProjectMemberTests-723363327 None] Deleted volume successfully. Jul 21 02:26:09 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f05842e1-865b-4b9c-9314-2e67a1680e50 tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94.ab147ef6-ba69-4517-a72e-ef008ada7d32" returned: 0 in 0.337s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:09 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ecf802b3-c36c-4294-9d82-86f82d304509 tempest-ProjectMemberTests-723363327 None] Lock "cinder-b71aece7-70f5-4223-8527-4d2a5f22c676-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f05842e1-865b-4b9c-9314-2e67a1680e50 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:09 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94.info Jul 21 02:26:09 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:09 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:26:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] Flow 'volume_create_manager' (68591a7b-a61a-4e82-8281-40f5c6685f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:26:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4aaf71e-f8da-4b07-9654-86b67f9ebe98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:09 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4aaf71e-f8da-4b07-9654-86b67f9ebe98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1785228813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f052a66-d2a5-42b1-9925-ac1ff78f931c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9180fe803c342ad96c373b69434c36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:26:10Z,use_quota=True,user_id='33a1095c5e17461e8e8a710d76a95247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (597120e8-e309-4fd1-9799-c87e382046e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (597120e8-e309-4fd1-9799-c87e382046e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fc0d7d1-2327-4743-a68e-5146c5e01fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fc0d7d1-2327-4743-a68e-5146c5e01fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f052a66-d2a5-42b1-9925-ac1ff78f931c', 'volume_name': 'volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f25c9ce-61f0-44a4-9522-8259e3972fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f25c9ce-61f0-44a4-9522-8259e3972fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:09 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73c69347-111b-431c-bf34-f51b8c05630e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:09 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] Volume 5f052a66-d2a5-42b1-9925-ac1ff78f931c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c', 'volume_size': 1} Jul 21 02:26:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f05842e1-865b-4b9c-9314-2e67a1680e50 tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94.info" returned: 0 in 0.348s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:09 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-f05842e1-865b-4b9c-9314-2e67a1680e50 tempest-ProjectReaderTests-1799797276 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94.info is being set with open permissions: ugo+rw Jul 21 02:26:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f05842e1-865b-4b9c-9314-2e67a1680e50 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:09 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94.info Jul 21 02:26:09 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:09 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:09 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-f05842e1-865b-4b9c-9314-2e67a1680e50 tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94.info" returned: 0 in 0.247s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-f05842e1-865b-4b9c-9314-2e67a1680e50 tempest-ProjectReaderTests-1799797276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.396s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.270s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:10 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1785228813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f052a66-d2a5-42b1-9925-ac1ff78f931c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9180fe803c342ad96c373b69434c36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:26:10Z,use_quota=True,user_id='33a1095c5e17461e8e8a710d76a95247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:26:10 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] Creating volume 5f052a66-d2a5-42b1-9925-ac1ff78f931c {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:26:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:10 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:26:10 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:26:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:10 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:26:10 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:26:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:10 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c 1073741824 Jul 21 02:26:10 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:10 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-f05842e1-865b-4b9c-9314-2e67a1680e50 tempest-ProjectReaderTests-1799797276 None] Create snapshot completed successfully Jul 21 02:26:10 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c 1073741824" returned: 0 in 0.458s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:10 devstack sudo[107866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c Jul 21 02:26:10 devstack sudo[107866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:10 devstack sudo[107866]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c" returned: 0 in 0.270s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:10 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:26:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73c69347-111b-431c-bf34-f51b8c05630e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90729221-aa16-4e97-8063-06fce3768607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:10 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-27b0b67b-7b91-4034-a361-addf96269a04 tempest-ProjectReaderTests-1799797276 None] Acquiring lock "cinder-ab147ef6-ba69-4517-a72e-ef008ada7d32-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:10 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] Volume volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c (5f052a66-d2a5-42b1-9925-ac1ff78f931c): created successfully Jul 21 02:26:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90729221-aa16-4e97-8063-06fce3768607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:10 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] Flow 'volume_create_manager' (68591a7b-a61a-4e82-8281-40f5c6685f76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:26:10 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-27b0b67b-7b91-4034-a361-addf96269a04 tempest-ProjectReaderTests-1799797276 None] Lock "cinder-ab147ef6-ba69-4517-a72e-ef008ada7d32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:10 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-27b0b67b-7b91-4034-a361-addf96269a04 tempest-ProjectReaderTests-1799797276 None] Acquiring lock "cinder-quobyte-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:10 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-27b0b67b-7b91-4034-a361-addf96269a04 tempest-ProjectReaderTests-1799797276 None] Lock "cinder-quobyte-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:10 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-27b0b67b-7b91-4034-a361-addf96269a04 tempest-ProjectReaderTests-1799797276 None] Acquiring lock "cinder-quobyte-ab147ef6-ba69-4517-a72e-ef008ada7d32" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:10 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-ba0361d2-ce5b-44d8-83fa-e0855cfd1d2c tempest-ProjectMemberTests-723363327 None] Created volume successfully. Jul 21 02:26:10 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-27b0b67b-7b91-4034-a361-addf96269a04 tempest-ProjectReaderTests-1799797276 None] Lock "cinder-quobyte-ab147ef6-ba69-4517-a72e-ef008ada7d32" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:10 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-27b0b67b-7b91-4034-a361-addf96269a04 tempest-ProjectReaderTests-1799797276 None] Deleting offline snapshot ab147ef6-ba69-4517-a72e-ef008ada7d32 of volume fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:26:10 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-27b0b67b-7b91-4034-a361-addf96269a04 tempest-ProjectReaderTests-1799797276 None] snapshot_file for this snap is: volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94.ab147ef6-ba69-4517-a72e-ef008ada7d32 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:26:10 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dcc58c-a393-4c8a-b45e-09b94c1729d2]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:10 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-27b0b67b-7b91-4034-a361-addf96269a04 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94.ab147ef6-ba69-4517-a72e-ef008ada7d32 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:11 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94.ab147ef6-ba69-4517-a72e-ef008ada7d32 Jul 21 02:26:11 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:11 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-27b0b67b-7b91-4034-a361-addf96269a04 tempest-ProjectReaderTests-1799797276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94.ab147ef6-ba69-4517-a72e-ef008ada7d32" returned: 0 in 0.376s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:11 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-27b0b67b-7b91-4034-a361-addf96269a04 tempest-ProjectReaderTests-1799797276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:26:11 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f87b30a-7eae-435c-b330-1ae1811cdf3e]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-27b0b67b-7b91-4034-a361-addf96269a04 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:11 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94 Jul 21 02:26:11 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:11 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-27b0b67b-7b91-4034-a361-addf96269a04 tempest-ProjectReaderTests-1799797276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94" returned: 0 in 0.439s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-27b0b67b-7b91-4034-a361-addf96269a04 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94.ab147ef6-ba69-4517-a72e-ef008ada7d32 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:11 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94.ab147ef6-ba69-4517-a72e-ef008ada7d32 Jul 21 02:26:11 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b7f874e3-8136-413a-b1de-eed8b0057519 tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b7f874e3-8136-413a-b1de-eed8b0057519 tempest-ProjectMemberTests-723363327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:11 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-b7f874e3-8136-413a-b1de-eed8b0057519 tempest-ProjectMemberTests-723363327 None] Creating offline snapshot 499be8f5-8ffe-401d-ab4b-8d4553a6bbc7 of volume 5f052a66-d2a5-42b1-9925-ac1ff78f931c {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:26:11 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[c885f8ee-cb04-4382-88de-693bd7cf425e]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:11 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b7f874e3-8136-413a-b1de-eed8b0057519 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:12 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c Jul 21 02:26:12 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:12 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-27b0b67b-7b91-4034-a361-addf96269a04 tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94.ab147ef6-ba69-4517-a72e-ef008ada7d32" returned: 0 in 0.477s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-27b0b67b-7b91-4034-a361-addf96269a04 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94.ab147ef6-ba69-4517-a72e-ef008ada7d32 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:12 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94.ab147ef6-ba69-4517-a72e-ef008ada7d32 Jul 21 02:26:12 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:12 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b7f874e3-8136-413a-b1de-eed8b0057519 tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c" returned: 0 in 0.482s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b7f874e3-8136-413a-b1de-eed8b0057519 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c.499be8f5-8ffe-401d-ab4b-8d4553a6bbc7 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:12 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c.499be8f5-8ffe-401d-ab4b-8d4553a6bbc7 1G Jul 21 02:26:12 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:12 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-27b0b67b-7b91-4034-a361-addf96269a04 tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94.ab147ef6-ba69-4517-a72e-ef008ada7d32" returned: 0 in 0.339s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:12 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-27b0b67b-7b91-4034-a361-addf96269a04 tempest-ProjectReaderTests-1799797276 None] Lock "cinder-quobyte-ab147ef6-ba69-4517-a72e-ef008ada7d32" released by "_delete_snapshot" :: held 1.738s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:12 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-27b0b67b-7b91-4034-a361-addf96269a04 tempest-ProjectReaderTests-1799797276 None] Lock "cinder-quobyte-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94" released by "delete_snapshot" :: held 1.773s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:12 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-27b0b67b-7b91-4034-a361-addf96269a04 tempest-ProjectReaderTests-1799797276 None] Created reservations ['faa7184c-b33d-45f6-87ae-20810b6eb9a1', 'ac789322-2188-4619-901a-cf7a1f5b4748', '57f8d00c-e707-48f3-aec8-b6eacc74f4fd', 'df8b40c8-135f-4bb2-ac5d-82f181f617e2'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:26:12 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-27b0b67b-7b91-4034-a361-addf96269a04 tempest-ProjectReaderTests-1799797276 None] Delete snapshot completed successfully. Jul 21 02:26:12 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-27b0b67b-7b91-4034-a361-addf96269a04 tempest-ProjectReaderTests-1799797276 None] Lock "cinder-ab147ef6-ba69-4517-a72e-ef008ada7d32-delete_snapshot" released by "delete_snapshot" :: held 1.943s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:12 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b7f874e3-8136-413a-b1de-eed8b0057519 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c.499be8f5-8ffe-401d-ab4b-8d4553a6bbc7 1G" returned: 0 in 0.505s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:12 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b7f874e3-8136-413a-b1de-eed8b0057519 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c.499be8f5-8ffe-401d-ab4b-8d4553a6bbc7 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:13 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c.499be8f5-8ffe-401d-ab4b-8d4553a6bbc7 Jul 21 02:26:13 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:13 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-99d25fb1-91f9-4a57-94df-e46c513245a4 tempest-ProjectReaderTests-1799797276 None] Acquiring lock "cinder-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:13 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-99d25fb1-91f9-4a57-94df-e46c513245a4 tempest-ProjectReaderTests-1799797276 None] Lock "cinder-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:13 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:26:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] Flow 'volume_create_manager' (bbc5a6a9-5846-4856-a7b5-b0f958ea1ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:26:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7161df17-6482-4617-bbe1-a50092825a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7161df17-6482-4617-bbe1-a50092825a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-303561712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c81dd0b-9603-470b-88eb-6db6da9c8bfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='868ac7e2d6814614934cbc5501f2e4f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:26:13Z,use_quota=True,user_id='008a741fb2194d9ebee2037701ca71ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95734ce6-7a9a-4e3d-b95b-cf6ca47c73aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95734ce6-7a9a-4e3d-b95b-cf6ca47c73aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06c79a86-f359-4b0f-bf5d-894d2e6f8e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06c79a86-f359-4b0f-bf5d-894d2e6f8e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c81dd0b-9603-470b-88eb-6db6da9c8bfa', 'volume_name': 'volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d092eeb3-074b-482c-ae13-59f06dddaa9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d092eeb3-074b-482c-ae13-59f06dddaa9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:13 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df67c560-23f1-434f-92d1-03809f2c52ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:13 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] Volume 5c81dd0b-9603-470b-88eb-6db6da9c8bfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa', 'volume_size': 1} Jul 21 02:26:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:13 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-99d25fb1-91f9-4a57-94df-e46c513245a4 tempest-ProjectReaderTests-1799797276 None] Acquiring lock "cinder-quobyte-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:13 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-99d25fb1-91f9-4a57-94df-e46c513245a4 tempest-ProjectReaderTests-1799797276 None] Lock "cinder-quobyte-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94" acquired by "delete_volume" :: waited 0.013s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:13 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39159ec-667a-4182-944f-2702a954891a]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-99d25fb1-91f9-4a57-94df-e46c513245a4 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:13 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b7f874e3-8136-413a-b1de-eed8b0057519 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c.499be8f5-8ffe-401d-ab4b-8d4553a6bbc7" returned: 0 in 0.310s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:13 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-b7f874e3-8136-413a-b1de-eed8b0057519 tempest-ProjectMemberTests-723363327 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c.499be8f5-8ffe-401d-ab4b-8d4553a6bbc7 is being set with open permissions: ugo+rw Jul 21 02:26:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b7f874e3-8136-413a-b1de-eed8b0057519 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c.499be8f5-8ffe-401d-ab4b-8d4553a6bbc7 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:13 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c.499be8f5-8ffe-401d-ab4b-8d4553a6bbc7 Jul 21 02:26:13 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:13 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94 Jul 21 02:26:13 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:13 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b7f874e3-8136-413a-b1de-eed8b0057519 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c.499be8f5-8ffe-401d-ab4b-8d4553a6bbc7" returned: 0 in 0.277s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b7f874e3-8136-413a-b1de-eed8b0057519 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:13 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-99d25fb1-91f9-4a57-94df-e46c513245a4 tempest-ProjectReaderTests-1799797276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94" returned: 0 in 0.375s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-99d25fb1-91f9-4a57-94df-e46c513245a4 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:13 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c.info Jul 21 02:26:13 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:13 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94 Jul 21 02:26:13 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:13 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b7f874e3-8136-413a-b1de-eed8b0057519 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c.info" returned: 0 in 0.250s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:13 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-b7f874e3-8136-413a-b1de-eed8b0057519 tempest-ProjectMemberTests-723363327 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c.info is being set with open permissions: ugo+rw Jul 21 02:26:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b7f874e3-8136-413a-b1de-eed8b0057519 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:13 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-99d25fb1-91f9-4a57-94df-e46c513245a4 tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94" returned: 0 in 0.261s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:13 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c.info Jul 21 02:26:13 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:13 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-99d25fb1-91f9-4a57-94df-e46c513245a4 tempest-ProjectReaderTests-1799797276 None] Lock "cinder-quobyte-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94" released by "delete_volume" :: held 0.689s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:13 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-99d25fb1-91f9-4a57-94df-e46c513245a4 tempest-ProjectReaderTests-1799797276 None] Created reservations ['8840d004-0cb4-422f-a3fe-abf536208972', 'fcee2328-b1e4-4d35-a963-1abf273b9a65', '046a1808-f106-4563-819f-a28ef4c55901', 'dedb8ea9-e2cf-4193-9e14-0a611dcd9871'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:26:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-99d25fb1-91f9-4a57-94df-e46c513245a4 tempest-ProjectReaderTests-1799797276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:13 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-99d25fb1-91f9-4a57-94df-e46c513245a4 tempest-ProjectReaderTests-1799797276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-99d25fb1-91f9-4a57-94df-e46c513245a4 tempest-ProjectReaderTests-1799797276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:26:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-99d25fb1-91f9-4a57-94df-e46c513245a4 tempest-ProjectReaderTests-1799797276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:26:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-99d25fb1-91f9-4a57-94df-e46c513245a4 tempest-ProjectReaderTests-1799797276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-99d25fb1-91f9-4a57-94df-e46c513245a4 tempest-ProjectReaderTests-1799797276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:14 devstack sudo[107921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:26:14 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:14 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b7f874e3-8136-413a-b1de-eed8b0057519 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c.info" returned: 0 in 0.253s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b7f874e3-8136-413a-b1de-eed8b0057519 tempest-ProjectMemberTests-723363327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.190s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.936s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-303561712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c81dd0b-9603-470b-88eb-6db6da9c8bfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='868ac7e2d6814614934cbc5501f2e4f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:26:13Z,use_quota=True,user_id='008a741fb2194d9ebee2037701ca71ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:26:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] Creating volume 5c81dd0b-9603-470b-88eb-6db6da9c8bfa {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:26:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:26:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:26:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:26:14 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:26:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:14 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa 1073741824 Jul 21 02:26:14 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:14 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-b7f874e3-8136-413a-b1de-eed8b0057519 tempest-ProjectMemberTests-723363327 None] Create snapshot completed successfully Jul 21 02:26:14 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-99d25fb1-91f9-4a57-94df-e46c513245a4 tempest-ProjectReaderTests-1799797276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.279s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:14 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-99d25fb1-91f9-4a57-94df-e46c513245a4 tempest-ProjectReaderTests-1799797276 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:26:14 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-99d25fb1-91f9-4a57-94df-e46c513245a4 tempest-ProjectReaderTests-1799797276 None] Deleted volume successfully. Jul 21 02:26:14 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-99d25fb1-91f9-4a57-94df-e46c513245a4 tempest-ProjectReaderTests-1799797276 None] Lock "cinder-fd65f2a4-0968-40f3-b1a7-ef6f89a2bd94-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:14 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa 1073741824" returned: 0 in 0.473s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:14 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa Jul 21 02:26:14 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:14 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa" returned: 0 in 0.242s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:14 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:26:14 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df67c560-23f1-434f-92d1-03809f2c52ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c202e0-2967-43eb-89b4-1a22a9325837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:14 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] Volume volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa (5c81dd0b-9603-470b-88eb-6db6da9c8bfa): created successfully Jul 21 02:26:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c202e0-2967-43eb-89b4-1a22a9325837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:14 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] Flow 'volume_create_manager' (bbc5a6a9-5846-4856-a7b5-b0f958ea1ab6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:26:14 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-6b0c1f76-0c1d-4145-86db-bad15c73cd01 tempest-SnapshotDependencyTests-524816322 None] Created volume successfully. Jul 21 02:26:15 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-770438a9-77e6-4d7a-b4b7-463c5e337e22 tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-499be8f5-8ffe-401d-ab4b-8d4553a6bbc7-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:15 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-770438a9-77e6-4d7a-b4b7-463c5e337e22 tempest-ProjectMemberTests-723363327 None] Lock "cinder-499be8f5-8ffe-401d-ab4b-8d4553a6bbc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:15 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-770438a9-77e6-4d7a-b4b7-463c5e337e22 tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-quobyte-5f052a66-d2a5-42b1-9925-ac1ff78f931c" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:15 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-770438a9-77e6-4d7a-b4b7-463c5e337e22 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-5f052a66-d2a5-42b1-9925-ac1ff78f931c" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:15 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-770438a9-77e6-4d7a-b4b7-463c5e337e22 tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-quobyte-499be8f5-8ffe-401d-ab4b-8d4553a6bbc7" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:15 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-770438a9-77e6-4d7a-b4b7-463c5e337e22 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-499be8f5-8ffe-401d-ab4b-8d4553a6bbc7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-770438a9-77e6-4d7a-b4b7-463c5e337e22 tempest-ProjectMemberTests-723363327 None] Deleting offline snapshot 499be8f5-8ffe-401d-ab4b-8d4553a6bbc7 of volume 5f052a66-d2a5-42b1-9925-ac1ff78f931c {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:26:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-770438a9-77e6-4d7a-b4b7-463c5e337e22 tempest-ProjectMemberTests-723363327 None] snapshot_file for this snap is: volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c.499be8f5-8ffe-401d-ab4b-8d4553a6bbc7 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:26:15 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[38508b36-a233-4c5a-805d-56ddf252af77]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-770438a9-77e6-4d7a-b4b7-463c5e337e22 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c.499be8f5-8ffe-401d-ab4b-8d4553a6bbc7 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:15 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c.499be8f5-8ffe-401d-ab4b-8d4553a6bbc7 Jul 21 02:26:15 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5833e353-d079-4fc9-9118-295073141c18 tempest-SnapshotDependencyTests-524816322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5833e353-d079-4fc9-9118-295073141c18 tempest-SnapshotDependencyTests-524816322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-5833e353-d079-4fc9-9118-295073141c18 tempest-SnapshotDependencyTests-524816322 None] Creating offline snapshot c9b13651-8a13-4be3-b5cc-899d0270275a of volume 5c81dd0b-9603-470b-88eb-6db6da9c8bfa {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:26:15 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b04ae9-d219-485e-a6bd-e329fc115dab]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5833e353-d079-4fc9-9118-295073141c18 tempest-SnapshotDependencyTests-524816322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:15 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-770438a9-77e6-4d7a-b4b7-463c5e337e22 tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c.499be8f5-8ffe-401d-ab4b-8d4553a6bbc7" returned: 0 in 0.422s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:15 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-770438a9-77e6-4d7a-b4b7-463c5e337e22 tempest-ProjectMemberTests-723363327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:26:15 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[1850c098-7b94-405f-b136-80c5a1ab772e]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:15 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-770438a9-77e6-4d7a-b4b7-463c5e337e22 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:15 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa Jul 21 02:26:15 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:15 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c Jul 21 02:26:15 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:16 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5833e353-d079-4fc9-9118-295073141c18 tempest-SnapshotDependencyTests-524816322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa" returned: 0 in 0.454s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5833e353-d079-4fc9-9118-295073141c18 tempest-SnapshotDependencyTests-524816322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa.c9b13651-8a13-4be3-b5cc-899d0270275a 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:16 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa.c9b13651-8a13-4be3-b5cc-899d0270275a 1G Jul 21 02:26:16 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:16 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-770438a9-77e6-4d7a-b4b7-463c5e337e22 tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c" returned: 0 in 0.406s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-770438a9-77e6-4d7a-b4b7-463c5e337e22 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c.499be8f5-8ffe-401d-ab4b-8d4553a6bbc7 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:16 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c.499be8f5-8ffe-401d-ab4b-8d4553a6bbc7 Jul 21 02:26:16 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:16 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5833e353-d079-4fc9-9118-295073141c18 tempest-SnapshotDependencyTests-524816322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa.c9b13651-8a13-4be3-b5cc-899d0270275a 1G" returned: 0 in 0.436s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5833e353-d079-4fc9-9118-295073141c18 tempest-SnapshotDependencyTests-524816322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa.c9b13651-8a13-4be3-b5cc-899d0270275a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:16 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-770438a9-77e6-4d7a-b4b7-463c5e337e22 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c.499be8f5-8ffe-401d-ab4b-8d4553a6bbc7" returned: 0 in 0.373s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-770438a9-77e6-4d7a-b4b7-463c5e337e22 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c.499be8f5-8ffe-401d-ab4b-8d4553a6bbc7 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:16 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa.c9b13651-8a13-4be3-b5cc-899d0270275a Jul 21 02:26:16 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:16 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c.499be8f5-8ffe-401d-ab4b-8d4553a6bbc7 Jul 21 02:26:16 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:16 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-770438a9-77e6-4d7a-b4b7-463c5e337e22 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c.499be8f5-8ffe-401d-ab4b-8d4553a6bbc7" returned: 0 in 0.280s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:16 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5833e353-d079-4fc9-9118-295073141c18 tempest-SnapshotDependencyTests-524816322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa.c9b13651-8a13-4be3-b5cc-899d0270275a" returned: 0 in 0.342s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:16 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-5833e353-d079-4fc9-9118-295073141c18 tempest-SnapshotDependencyTests-524816322 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa.c9b13651-8a13-4be3-b5cc-899d0270275a is being set with open permissions: ugo+rw Jul 21 02:26:16 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5833e353-d079-4fc9-9118-295073141c18 tempest-SnapshotDependencyTests-524816322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa.c9b13651-8a13-4be3-b5cc-899d0270275a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:16 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-770438a9-77e6-4d7a-b4b7-463c5e337e22 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-499be8f5-8ffe-401d-ab4b-8d4553a6bbc7" released by "_delete_snapshot" :: held 1.626s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:16 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-770438a9-77e6-4d7a-b4b7-463c5e337e22 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-5f052a66-d2a5-42b1-9925-ac1ff78f931c" released by "delete_snapshot" :: held 1.658s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:16 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa.c9b13651-8a13-4be3-b5cc-899d0270275a Jul 21 02:26:16 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:16 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-770438a9-77e6-4d7a-b4b7-463c5e337e22 tempest-ProjectMemberTests-723363327 None] Created reservations ['ffea7317-3157-4192-86c4-34b6d9783515', '88d2ef3a-15c1-4124-8c8c-59525938d23b', '8d759851-1cab-4629-aa60-9b3b34b7e534', 'f23ccd2b-01ce-4e9a-8864-f9e871b8e43e'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:26:16 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-770438a9-77e6-4d7a-b4b7-463c5e337e22 tempest-ProjectMemberTests-723363327 None] Delete snapshot completed successfully. Jul 21 02:26:16 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-770438a9-77e6-4d7a-b4b7-463c5e337e22 tempest-ProjectMemberTests-723363327 None] Lock "cinder-499be8f5-8ffe-401d-ab4b-8d4553a6bbc7-delete_snapshot" released by "delete_snapshot" :: held 1.837s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:17 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5833e353-d079-4fc9-9118-295073141c18 tempest-SnapshotDependencyTests-524816322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa.c9b13651-8a13-4be3-b5cc-899d0270275a" returned: 0 in 0.248s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5833e353-d079-4fc9-9118-295073141c18 tempest-SnapshotDependencyTests-524816322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:17 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa.info Jul 21 02:26:17 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3e0b9183-a1ff-489b-87f1-ccda31814411 tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-5f052a66-d2a5-42b1-9925-ac1ff78f931c-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3e0b9183-a1ff-489b-87f1-ccda31814411 tempest-ProjectMemberTests-723363327 None] Lock "cinder-5f052a66-d2a5-42b1-9925-ac1ff78f931c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3e0b9183-a1ff-489b-87f1-ccda31814411 tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-quobyte-5f052a66-d2a5-42b1-9925-ac1ff78f931c" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:17 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5833e353-d079-4fc9-9118-295073141c18 tempest-SnapshotDependencyTests-524816322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa.info" returned: 0 in 0.316s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:17 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-5833e353-d079-4fc9-9118-295073141c18 tempest-SnapshotDependencyTests-524816322 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa.info is being set with open permissions: ugo+rw Jul 21 02:26:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5833e353-d079-4fc9-9118-295073141c18 tempest-SnapshotDependencyTests-524816322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:17 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3e0b9183-a1ff-489b-87f1-ccda31814411 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-5f052a66-d2a5-42b1-9925-ac1ff78f931c" acquired by "delete_volume" :: waited 0.035s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:17 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa.info Jul 21 02:26:17 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:17 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[54631509-1bec-46a7-904f-b4b41e6ba19b]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3e0b9183-a1ff-489b-87f1-ccda31814411 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:17 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c Jul 21 02:26:17 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:17 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-5833e353-d079-4fc9-9118-295073141c18 tempest-SnapshotDependencyTests-524816322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa.info" returned: 0 in 0.300s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-5833e353-d079-4fc9-9118-295073141c18 tempest-SnapshotDependencyTests-524816322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.186s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:17 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-5833e353-d079-4fc9-9118-295073141c18 tempest-SnapshotDependencyTests-524816322 None] Create snapshot completed successfully Jul 21 02:26:17 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3e0b9183-a1ff-489b-87f1-ccda31814411 tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c" returned: 0 in 0.370s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:17 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3e0b9183-a1ff-489b-87f1-ccda31814411 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:17 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c Jul 21 02:26:17 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:18 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3e0b9183-a1ff-489b-87f1-ccda31814411 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5f052a66-d2a5-42b1-9925-ac1ff78f931c" returned: 0 in 0.244s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3e0b9183-a1ff-489b-87f1-ccda31814411 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-5f052a66-d2a5-42b1-9925-ac1ff78f931c" released by "delete_volume" :: held 0.688s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:18 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-3e0b9183-a1ff-489b-87f1-ccda31814411 tempest-ProjectMemberTests-723363327 None] Created reservations ['35fc3253-39e3-417b-a76c-020792d4872c', '881f166b-0cad-49db-ae81-4dfa5563ce59', 'c8e209b4-e93a-4496-b590-c4d29516797e', '598160fd-ec89-45b3-9dce-81f1d1b502aa'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:26:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3e0b9183-a1ff-489b-87f1-ccda31814411 tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3e0b9183-a1ff-489b-87f1-ccda31814411 tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-3e0b9183-a1ff-489b-87f1-ccda31814411 tempest-ProjectMemberTests-723363327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:26:18 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-3e0b9183-a1ff-489b-87f1-ccda31814411 tempest-ProjectMemberTests-723363327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:26:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-3e0b9183-a1ff-489b-87f1-ccda31814411 tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3e0b9183-a1ff-489b-87f1-ccda31814411 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:18 devstack sudo[107984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:26:18 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:18 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:18 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-3e0b9183-a1ff-489b-87f1-ccda31814411 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.250s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:18 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-3e0b9183-a1ff-489b-87f1-ccda31814411 tempest-ProjectMemberTests-723363327 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:26:18 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-3e0b9183-a1ff-489b-87f1-ccda31814411 tempest-ProjectMemberTests-723363327 None] Deleted volume successfully. Jul 21 02:26:18 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-3e0b9183-a1ff-489b-87f1-ccda31814411 tempest-ProjectMemberTests-723363327 None] Lock "cinder-5f052a66-d2a5-42b1-9925-ac1ff78f931c-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:18 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:26:18 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] Flow 'volume_create_manager' (249e9a73-6190-482f-842c-7d6698c8cc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23eeaee2-3e39-4986-806e-043936a2ce1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23eeaee2-3e39-4986-806e-043936a2ce1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-329080708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488c00fc-111e-429a-b4dd-5d9a3f55c53c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9180fe803c342ad96c373b69434c36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:26:19Z,use_quota=True,user_id='33a1095c5e17461e8e8a710d76a95247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a55bc04-f8a6-4aaa-84c5-df49f5705fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a55bc04-f8a6-4aaa-84c5-df49f5705fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be8fea9a-b2ed-443f-b503-a29fd50e01a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be8fea9a-b2ed-443f-b503-a29fd50e01a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '488c00fc-111e-429a-b4dd-5d9a3f55c53c', 'volume_name': 'volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57de6c7-581c-4acd-9da6-367f885dbe30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57de6c7-581c-4acd-9da6-367f885dbe30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3344b1ea-1c36-4f59-9568-0441a697f75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:19 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] Volume 488c00fc-111e-429a-b4dd-5d9a3f55c53c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c', 'volume_size': 1} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-329080708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488c00fc-111e-429a-b4dd-5d9a3f55c53c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9180fe803c342ad96c373b69434c36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:26:19Z,use_quota=True,user_id='33a1095c5e17461e8e8a710d76a95247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] Creating volume 488c00fc-111e-429a-b4dd-5d9a3f55c53c {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:26:19 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:19 devstack sudo[107987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c 1073741824 Jul 21 02:26:19 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Flow 'volume_create_manager' (32e3cc82-031f-41ef-836d-02327d454ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbb8b5d3-b2aa-4c4a-9dcb-f860e6d43a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbb8b5d3-b2aa-4c4a-9dcb-f860e6d43a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8111a610-6039-4947-80d8-2965c1b30f08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='868ac7e2d6814614934cbc5501f2e4f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c9b13651-8a13-4be3-b5cc-899d0270275a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:26:19Z,use_quota=True,user_id='008a741fb2194d9ebee2037701ca71ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5285bbfb-bf99-423b-843f-70c223d2e754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5285bbfb-bf99-423b-843f-70c223d2e754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93976d11-6dbc-4366-bc13-e13f798fe98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93976d11-6dbc-4366-bc13-e13f798fe98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8111a610-6039-4947-80d8-2965c1b30f08', 'volume_name': 'volume-8111a610-6039-4947-80d8-2965c1b30f08', 'volume_size': 1, 'snapshot_id': 'c9b13651-8a13-4be3-b5cc-899d0270275a'}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f69a1e-50cb-47ba-935b-5cf572565f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f69a1e-50cb-47ba-935b-5cf572565f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57cd3f5a-c6af-401e-b319-f8dcbc227c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:19 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Volume 8111a610-6039-4947-80d8-2965c1b30f08: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8111a610-6039-4947-80d8-2965c1b30f08', 'volume_size': 1, 'snapshot_id': 'c9b13651-8a13-4be3-b5cc-899d0270275a'} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:19 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c 1073741824" returned: 0 in 0.521s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:19 devstack sudo[107993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c Jul 21 02:26:19 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:19 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c" returned: 0 in 0.254s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.443s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Acquiring lock "cinder-quobyte-c9b13651-8a13-4be3-b5cc-899d0270275a-8111a610-6039-4947-80d8-2965c1b30f08" by "_create_volume_from_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3344b1ea-1c36-4f59-9568-0441a697f75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (632b6a27-8818-4ba0-a09e-040d21b42621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Lock "cinder-quobyte-c9b13651-8a13-4be3-b5cc-899d0270275a-8111a610-6039-4947-80d8-2965c1b30f08" acquired by "_create_volume_from_snapshot" :: waited 0.050s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Creating volume 8111a610-6039-4947-80d8-2965c1b30f08 from snapshot c9b13651-8a13-4be3-b5cc-899d0270275a {{(pid=87566) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Acquiring lock "cinder-quobyte-8111a610-6039-4947-80d8-2965c1b30f08" by "_copy_volume_from_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:19 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] Volume volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c (488c00fc-111e-429a-b4dd-5d9a3f55c53c): created successfully Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (632b6a27-8818-4ba0-a09e-040d21b42621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] Flow 'volume_create_manager' (249e9a73-6190-482f-842c-7d6698c8cc32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Lock "cinder-quobyte-8111a610-6039-4947-80d8-2965c1b30f08" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:19 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] snapshot: c9b13651-8a13-4be3-b5cc-899d0270275a, volume: 8111a610-6039-4947-80d8-2965c1b30f08, {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 02:26:19 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-175f1be0-d320-4ba7-9af3-b83632e5f42c tempest-ProjectMemberTests-723363327 None] Created volume successfully. Jul 21 02:26:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:20 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:26:20 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:26:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:20 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[571a2267-d4be-45d4-903b-36101c8f4905]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa.c9b13651-8a13-4be3-b5cc-899d0270275a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:20 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa.c9b13651-8a13-4be3-b5cc-899d0270275a Jul 21 02:26:20 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:20 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa.c9b13651-8a13-4be3-b5cc-899d0270275a" returned: 0 in 0.383s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:20 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:26:20 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 02:26:20 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Creating direct copy from snapshot {{(pid=87566) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 02:26:20 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[417fc09e-380a-43cb-9011-4c5841766a53]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:20 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa Jul 21 02:26:20 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:20 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa" returned: 0 in 0.342s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:20 devstack cinder-volume[87566]: DEBUG cinder.utils [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Path /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8111a610-6039-4947-80d8-2965c1b30f08 not found in is_blk_device check {{(pid=87566) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 02:26:20 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8111a610-6039-4947-80d8-2965c1b30f08 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:20 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8111a610-6039-4947-80d8-2965c1b30f08 Jul 21 02:26:20 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:21 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cc4a6772-0fbf-424f-929e-2b0956d64b6b tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:25 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8111a610-6039-4947-80d8-2965c1b30f08" returned: 0 in 5.115s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:25 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ceccef-afcc-4b92-8588-17761ee77ce2]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:25 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:26 devstack sudo[108022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa Jul 21 02:26:26 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:26 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa" returned: 0 in 0.522s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:26 devstack cinder-volume[87566]: DEBUG cinder.image.image_utils [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Image conversion details: src /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa, size 1024.00 MB, duration 5.12 sec, destination /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8111a610-6039-4947-80d8-2965c1b30f08 {{(pid=87566) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 02:26:26 devstack cinder-volume[87566]: INFO cinder.image.image_utils [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Converted 1024.00 MB image at 200.17 MB/s Jul 21 02:26:26 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8111a610-6039-4947-80d8-2965c1b30f08 is being set with open permissions: ugo+rw Jul 21 02:26:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8111a610-6039-4947-80d8-2965c1b30f08 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:26 devstack sudo[108027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8111a610-6039-4947-80d8-2965c1b30f08 Jul 21 02:26:26 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:26 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8111a610-6039-4947-80d8-2965c1b30f08" returned: 0 in 0.251s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:26 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Lock "cinder-quobyte-8111a610-6039-4947-80d8-2965c1b30f08" released by "_copy_volume_from_snapshot" :: held 6.718s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:26 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Lock "cinder-quobyte-c9b13651-8a13-4be3-b5cc-899d0270275a-8111a610-6039-4947-80d8-2965c1b30f08" released by "_create_volume_from_snapshot" :: held 6.765s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.817s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cc4a6772-0fbf-424f-929e-2b0956d64b6b tempest-ProjectMemberTests-723363327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.488s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:26 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-cc4a6772-0fbf-424f-929e-2b0956d64b6b tempest-ProjectMemberTests-723363327 None] Creating offline snapshot e600e7d0-9d28-457b-891a-333d86b4355f of volume 488c00fc-111e-429a-b4dd-5d9a3f55c53c {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:26:26 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57cd3f5a-c6af-401e-b319-f8dcbc227c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8111a610-6039-4947-80d8-2965c1b30f08', 'volume_size': 1, 'snapshot_id': 'c9b13651-8a13-4be3-b5cc-899d0270275a'}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:26 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96e3eb43-6b1e-4387-94e2-71b292d22f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:26 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6f14e2-5085-480c-8b9a-caebb3408552]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:26 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cc4a6772-0fbf-424f-929e-2b0956d64b6b tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:26 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Volume volume-8111a610-6039-4947-80d8-2965c1b30f08 (8111a610-6039-4947-80d8-2965c1b30f08): created successfully Jul 21 02:26:26 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96e3eb43-6b1e-4387-94e2-71b292d22f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:26 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Flow 'volume_create_manager' (32e3cc82-031f-41ef-836d-02327d454ce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:26:26 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-b5acbcce-5a7f-4bba-b826-f261e3397dba tempest-SnapshotDependencyTests-524816322 None] Created volume successfully. Jul 21 02:26:26 devstack sudo[108030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c Jul 21 02:26:26 devstack sudo[108030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:27 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6859f252-dcba-4709-9bb1-ed82d3d6a3e6 tempest-SnapshotDependencyTests-524816322 None] Acquiring lock "cinder-c9b13651-8a13-4be3-b5cc-899d0270275a-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:27 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6859f252-dcba-4709-9bb1-ed82d3d6a3e6 tempest-SnapshotDependencyTests-524816322 None] Lock "cinder-c9b13651-8a13-4be3-b5cc-899d0270275a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:27 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6859f252-dcba-4709-9bb1-ed82d3d6a3e6 tempest-SnapshotDependencyTests-524816322 None] Acquiring lock "cinder-quobyte-5c81dd0b-9603-470b-88eb-6db6da9c8bfa" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:27 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6859f252-dcba-4709-9bb1-ed82d3d6a3e6 tempest-SnapshotDependencyTests-524816322 None] Lock "cinder-quobyte-5c81dd0b-9603-470b-88eb-6db6da9c8bfa" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:27 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6859f252-dcba-4709-9bb1-ed82d3d6a3e6 tempest-SnapshotDependencyTests-524816322 None] Acquiring lock "cinder-quobyte-c9b13651-8a13-4be3-b5cc-899d0270275a" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:27 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6859f252-dcba-4709-9bb1-ed82d3d6a3e6 tempest-SnapshotDependencyTests-524816322 None] Lock "cinder-quobyte-c9b13651-8a13-4be3-b5cc-899d0270275a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:27 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-6859f252-dcba-4709-9bb1-ed82d3d6a3e6 tempest-SnapshotDependencyTests-524816322 None] Deleting offline snapshot c9b13651-8a13-4be3-b5cc-899d0270275a of volume 5c81dd0b-9603-470b-88eb-6db6da9c8bfa {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:26:27 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-6859f252-dcba-4709-9bb1-ed82d3d6a3e6 tempest-SnapshotDependencyTests-524816322 None] snapshot_file for this snap is: volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa.c9b13651-8a13-4be3-b5cc-899d0270275a {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:26:27 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[2643fced-2a12-43cc-a728-9a11668eb9f8]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6859f252-dcba-4709-9bb1-ed82d3d6a3e6 tempest-SnapshotDependencyTests-524816322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa.c9b13651-8a13-4be3-b5cc-899d0270275a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:27 devstack sudo[108030]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cc4a6772-0fbf-424f-929e-2b0956d64b6b tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c" returned: 0 in 0.427s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cc4a6772-0fbf-424f-929e-2b0956d64b6b tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c.e600e7d0-9d28-457b-891a-333d86b4355f 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:27 devstack sudo[108036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c.e600e7d0-9d28-457b-891a-333d86b4355f 1G Jul 21 02:26:27 devstack sudo[108036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:27 devstack sudo[108034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa.c9b13651-8a13-4be3-b5cc-899d0270275a Jul 21 02:26:27 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:27 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6859f252-dcba-4709-9bb1-ed82d3d6a3e6 tempest-SnapshotDependencyTests-524816322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa.c9b13651-8a13-4be3-b5cc-899d0270275a" returned: 0 in 0.396s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:27 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-6859f252-dcba-4709-9bb1-ed82d3d6a3e6 tempest-SnapshotDependencyTests-524816322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:26:27 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb9cdff-455a-444e-8ac4-17fd436f29b3]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6859f252-dcba-4709-9bb1-ed82d3d6a3e6 tempest-SnapshotDependencyTests-524816322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:27 devstack sudo[108036]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cc4a6772-0fbf-424f-929e-2b0956d64b6b tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c.e600e7d0-9d28-457b-891a-333d86b4355f 1G" returned: 0 in 0.458s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cc4a6772-0fbf-424f-929e-2b0956d64b6b tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c.e600e7d0-9d28-457b-891a-333d86b4355f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:27 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa Jul 21 02:26:27 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:27 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c.e600e7d0-9d28-457b-891a-333d86b4355f Jul 21 02:26:27 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:27 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6859f252-dcba-4709-9bb1-ed82d3d6a3e6 tempest-SnapshotDependencyTests-524816322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa" returned: 0 in 0.418s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:27 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6859f252-dcba-4709-9bb1-ed82d3d6a3e6 tempest-SnapshotDependencyTests-524816322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa.c9b13651-8a13-4be3-b5cc-899d0270275a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:27 devstack sudo[108057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa.c9b13651-8a13-4be3-b5cc-899d0270275a Jul 21 02:26:27 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:28 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cc4a6772-0fbf-424f-929e-2b0956d64b6b tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c.e600e7d0-9d28-457b-891a-333d86b4355f" returned: 0 in 0.374s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:28 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-cc4a6772-0fbf-424f-929e-2b0956d64b6b tempest-ProjectMemberTests-723363327 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c.e600e7d0-9d28-457b-891a-333d86b4355f is being set with open permissions: ugo+rw Jul 21 02:26:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cc4a6772-0fbf-424f-929e-2b0956d64b6b tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c.e600e7d0-9d28-457b-891a-333d86b4355f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:28 devstack sudo[108059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c.e600e7d0-9d28-457b-891a-333d86b4355f Jul 21 02:26:28 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:28 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cc4a6772-0fbf-424f-929e-2b0956d64b6b tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c.e600e7d0-9d28-457b-891a-333d86b4355f" returned: 0 in 0.268s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:28 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=170,cinder:UPDATE=210,cinder:DELETE=21,cinder:INSERT=55 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:26:28 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cc4a6772-0fbf-424f-929e-2b0956d64b6b tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6859f252-dcba-4709-9bb1-ed82d3d6a3e6 tempest-SnapshotDependencyTests-524816322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa.c9b13651-8a13-4be3-b5cc-899d0270275a" returned: 0 in 0.390s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6859f252-dcba-4709-9bb1-ed82d3d6a3e6 tempest-SnapshotDependencyTests-524816322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa.c9b13651-8a13-4be3-b5cc-899d0270275a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:28 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c.info Jul 21 02:26:28 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:28 devstack sudo[108068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa.c9b13651-8a13-4be3-b5cc-899d0270275a Jul 21 02:26:28 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:28 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-6859f252-dcba-4709-9bb1-ed82d3d6a3e6 tempest-SnapshotDependencyTests-524816322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa.c9b13651-8a13-4be3-b5cc-899d0270275a" returned: 0 in 0.250s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:28 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cc4a6772-0fbf-424f-929e-2b0956d64b6b tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c.info" returned: 0 in 0.282s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:28 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-cc4a6772-0fbf-424f-929e-2b0956d64b6b tempest-ProjectMemberTests-723363327 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c.info is being set with open permissions: ugo+rw Jul 21 02:26:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cc4a6772-0fbf-424f-929e-2b0956d64b6b tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:28 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c.info Jul 21 02:26:28 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:28 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6859f252-dcba-4709-9bb1-ed82d3d6a3e6 tempest-SnapshotDependencyTests-524816322 None] Lock "cinder-quobyte-c9b13651-8a13-4be3-b5cc-899d0270275a" released by "_delete_snapshot" :: held 1.592s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:28 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6859f252-dcba-4709-9bb1-ed82d3d6a3e6 tempest-SnapshotDependencyTests-524816322 None] Lock "cinder-quobyte-5c81dd0b-9603-470b-88eb-6db6da9c8bfa" released by "delete_snapshot" :: held 1.619s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:28 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=157,cinder:UPDATE=208,cinder:INSERT=58,cinder:DELETE=16 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:26:28 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-6859f252-dcba-4709-9bb1-ed82d3d6a3e6 tempest-SnapshotDependencyTests-524816322 None] Created reservations ['4e5a4f13-2939-45ff-bca1-30a6ef96c902', '2ac29c25-c46b-44d5-8a04-c0600e611a46', '939be8a9-4495-4ae4-9759-8817fee9bbcb', '9bc723ff-8ccd-4087-abb9-c3fd48ece983'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:26:28 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-6859f252-dcba-4709-9bb1-ed82d3d6a3e6 tempest-SnapshotDependencyTests-524816322 None] Delete snapshot completed successfully. Jul 21 02:26:28 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-6859f252-dcba-4709-9bb1-ed82d3d6a3e6 tempest-SnapshotDependencyTests-524816322 None] Lock "cinder-c9b13651-8a13-4be3-b5cc-899d0270275a-delete_snapshot" released by "delete_snapshot" :: held 1.793s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:28 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-cc4a6772-0fbf-424f-929e-2b0956d64b6b tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c.info" returned: 0 in 0.275s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:28 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-cc4a6772-0fbf-424f-929e-2b0956d64b6b tempest-ProjectMemberTests-723363327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.195s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:28 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-cc4a6772-0fbf-424f-929e-2b0956d64b6b tempest-ProjectMemberTests-723363327 None] Create snapshot completed successfully Jul 21 02:26:29 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ef9af948-cff0-45f5-a116-9b9725b817d7 tempest-SnapshotDependencyTests-524816322 None] Acquiring lock "cinder-5c81dd0b-9603-470b-88eb-6db6da9c8bfa-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:29 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ef9af948-cff0-45f5-a116-9b9725b817d7 tempest-SnapshotDependencyTests-524816322 None] Lock "cinder-5c81dd0b-9603-470b-88eb-6db6da9c8bfa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:29 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ef9af948-cff0-45f5-a116-9b9725b817d7 tempest-SnapshotDependencyTests-524816322 None] Acquiring lock "cinder-quobyte-5c81dd0b-9603-470b-88eb-6db6da9c8bfa" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:29 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ef9af948-cff0-45f5-a116-9b9725b817d7 tempest-SnapshotDependencyTests-524816322 None] Lock "cinder-quobyte-5c81dd0b-9603-470b-88eb-6db6da9c8bfa" acquired by "delete_volume" :: waited 0.017s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:29 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[66297784-78b8-42fd-bca9-6e5ed08095c1]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ef9af948-cff0-45f5-a116-9b9725b817d7 tempest-SnapshotDependencyTests-524816322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:29 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa Jul 21 02:26:29 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:29 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ef9af948-cff0-45f5-a116-9b9725b817d7 tempest-SnapshotDependencyTests-524816322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa" returned: 0 in 0.401s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:29 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ef9af948-cff0-45f5-a116-9b9725b817d7 tempest-SnapshotDependencyTests-524816322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:29 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa Jul 21 02:26:29 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:29 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4f78c465-8bd8-4296-a605-1bf9bb35a584 tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-e600e7d0-9d28-457b-891a-333d86b4355f-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:29 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4f78c465-8bd8-4296-a605-1bf9bb35a584 tempest-ProjectMemberTests-723363327 None] Lock "cinder-e600e7d0-9d28-457b-891a-333d86b4355f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:29 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4f78c465-8bd8-4296-a605-1bf9bb35a584 tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-quobyte-488c00fc-111e-429a-b4dd-5d9a3f55c53c" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:29 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4f78c465-8bd8-4296-a605-1bf9bb35a584 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-488c00fc-111e-429a-b4dd-5d9a3f55c53c" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:29 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4f78c465-8bd8-4296-a605-1bf9bb35a584 tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-quobyte-e600e7d0-9d28-457b-891a-333d86b4355f" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4f78c465-8bd8-4296-a605-1bf9bb35a584 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-e600e7d0-9d28-457b-891a-333d86b4355f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:30 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-4f78c465-8bd8-4296-a605-1bf9bb35a584 tempest-ProjectMemberTests-723363327 None] Deleting offline snapshot e600e7d0-9d28-457b-891a-333d86b4355f of volume 488c00fc-111e-429a-b4dd-5d9a3f55c53c {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:26:30 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:30 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-4f78c465-8bd8-4296-a605-1bf9bb35a584 tempest-ProjectMemberTests-723363327 None] snapshot_file for this snap is: volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c.e600e7d0-9d28-457b-891a-333d86b4355f {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:26:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ef9af948-cff0-45f5-a116-9b9725b817d7 tempest-SnapshotDependencyTests-524816322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-5c81dd0b-9603-470b-88eb-6db6da9c8bfa" returned: 0 in 0.324s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:30 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1b4bb8-b7ba-4441-871f-cc1023fe69f2]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4f78c465-8bd8-4296-a605-1bf9bb35a584 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c.e600e7d0-9d28-457b-891a-333d86b4355f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ef9af948-cff0-45f5-a116-9b9725b817d7 tempest-SnapshotDependencyTests-524816322 None] Lock "cinder-quobyte-5c81dd0b-9603-470b-88eb-6db6da9c8bfa" released by "delete_volume" :: held 0.800s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:30 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-ef9af948-cff0-45f5-a116-9b9725b817d7 tempest-SnapshotDependencyTests-524816322 None] Created reservations ['c1194082-e925-4de0-bf8a-e08c432c5375', '32693c0c-3367-4f8f-abaa-ee9f0c42786a', 'c7207668-c56d-40b2-9829-1a50644df88b', 'f3f68cb7-da0a-4087-81c1-21aa3530476a'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:26:30 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c.e600e7d0-9d28-457b-891a-333d86b4355f Jul 21 02:26:30 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ef9af948-cff0-45f5-a116-9b9725b817d7 tempest-SnapshotDependencyTests-524816322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ef9af948-cff0-45f5-a116-9b9725b817d7 tempest-SnapshotDependencyTests-524816322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:30 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ef9af948-cff0-45f5-a116-9b9725b817d7 tempest-SnapshotDependencyTests-524816322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:26:30 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-ef9af948-cff0-45f5-a116-9b9725b817d7 tempest-SnapshotDependencyTests-524816322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:26:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-ef9af948-cff0-45f5-a116-9b9725b817d7 tempest-SnapshotDependencyTests-524816322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ef9af948-cff0-45f5-a116-9b9725b817d7 tempest-SnapshotDependencyTests-524816322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:30 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:26:30 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d89be62e-1fcf-4be4-b78d-419d1baa9291 tempest-SnapshotDependencyTests-524816322 None] Acquiring lock "cinder-8111a610-6039-4947-80d8-2965c1b30f08-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d89be62e-1fcf-4be4-b78d-419d1baa9291 tempest-SnapshotDependencyTests-524816322 None] Lock "cinder-8111a610-6039-4947-80d8-2965c1b30f08-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:30 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4f78c465-8bd8-4296-a605-1bf9bb35a584 tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c.e600e7d0-9d28-457b-891a-333d86b4355f" returned: 0 in 0.451s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:30 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-4f78c465-8bd8-4296-a605-1bf9bb35a584 tempest-ProjectMemberTests-723363327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:26:30 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[6250b1e0-97bf-4eb8-a2e9-4fb233a7d8c5]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4f78c465-8bd8-4296-a605-1bf9bb35a584 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d89be62e-1fcf-4be4-b78d-419d1baa9291 tempest-SnapshotDependencyTests-524816322 None] Acquiring lock "cinder-quobyte-8111a610-6039-4947-80d8-2965c1b30f08" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:30 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d89be62e-1fcf-4be4-b78d-419d1baa9291 tempest-SnapshotDependencyTests-524816322 None] Lock "cinder-quobyte-8111a610-6039-4947-80d8-2965c1b30f08" acquired by "delete_volume" :: waited 0.021s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-ef9af948-cff0-45f5-a116-9b9725b817d7 tempest-SnapshotDependencyTests-524816322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.415s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:30 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-ef9af948-cff0-45f5-a116-9b9725b817d7 tempest-SnapshotDependencyTests-524816322 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:26:30 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-ef9af948-cff0-45f5-a116-9b9725b817d7 tempest-SnapshotDependencyTests-524816322 None] Deleted volume successfully. Jul 21 02:26:30 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[5869648c-0622-4e76-9327-515d3044dac7]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d89be62e-1fcf-4be4-b78d-419d1baa9291 tempest-SnapshotDependencyTests-524816322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8111a610-6039-4947-80d8-2965c1b30f08 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:30 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-ef9af948-cff0-45f5-a116-9b9725b817d7 tempest-SnapshotDependencyTests-524816322 None] Lock "cinder-5c81dd0b-9603-470b-88eb-6db6da9c8bfa-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:30 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c Jul 21 02:26:30 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:30 devstack sudo[108094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8111a610-6039-4947-80d8-2965c1b30f08 Jul 21 02:26:30 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:30 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4f78c465-8bd8-4296-a605-1bf9bb35a584 tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c" returned: 0 in 0.405s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:30 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4f78c465-8bd8-4296-a605-1bf9bb35a584 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c.e600e7d0-9d28-457b-891a-333d86b4355f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:30 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c.e600e7d0-9d28-457b-891a-333d86b4355f Jul 21 02:26:30 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:31 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d89be62e-1fcf-4be4-b78d-419d1baa9291 tempest-SnapshotDependencyTests-524816322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8111a610-6039-4947-80d8-2965c1b30f08" returned: 0 in 0.440s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d89be62e-1fcf-4be4-b78d-419d1baa9291 tempest-SnapshotDependencyTests-524816322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8111a610-6039-4947-80d8-2965c1b30f08 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:31 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8111a610-6039-4947-80d8-2965c1b30f08 Jul 21 02:26:31 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:31 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4f78c465-8bd8-4296-a605-1bf9bb35a584 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c.e600e7d0-9d28-457b-891a-333d86b4355f" returned: 0 in 0.382s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4f78c465-8bd8-4296-a605-1bf9bb35a584 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c.e600e7d0-9d28-457b-891a-333d86b4355f {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:31 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d89be62e-1fcf-4be4-b78d-419d1baa9291 tempest-SnapshotDependencyTests-524816322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-8111a610-6039-4947-80d8-2965c1b30f08" returned: 0 in 0.292s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:31 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c.e600e7d0-9d28-457b-891a-333d86b4355f Jul 21 02:26:31 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:31 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d89be62e-1fcf-4be4-b78d-419d1baa9291 tempest-SnapshotDependencyTests-524816322 None] Lock "cinder-quobyte-8111a610-6039-4947-80d8-2965c1b30f08" released by "delete_volume" :: held 0.787s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:31 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-d89be62e-1fcf-4be4-b78d-419d1baa9291 tempest-SnapshotDependencyTests-524816322 None] Created reservations ['ec365841-f99c-46f2-b02a-b7081f258e42', '480faa1c-ee53-4227-b69d-89fa85cec0c4', '14c13abe-c2bb-48ef-b9e2-2909500ab51b', '6e06cb3e-c5be-4c60-84b7-0b82bc31291b'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:26:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d89be62e-1fcf-4be4-b78d-419d1baa9291 tempest-SnapshotDependencyTests-524816322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d89be62e-1fcf-4be4-b78d-419d1baa9291 tempest-SnapshotDependencyTests-524816322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:31 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d89be62e-1fcf-4be4-b78d-419d1baa9291 tempest-SnapshotDependencyTests-524816322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:26:31 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-d89be62e-1fcf-4be4-b78d-419d1baa9291 tempest-SnapshotDependencyTests-524816322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:26:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-d89be62e-1fcf-4be4-b78d-419d1baa9291 tempest-SnapshotDependencyTests-524816322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d89be62e-1fcf-4be4-b78d-419d1baa9291 tempest-SnapshotDependencyTests-524816322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:31 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:26:31 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:31 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-4f78c465-8bd8-4296-a605-1bf9bb35a584 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c.e600e7d0-9d28-457b-891a-333d86b4355f" returned: 0 in 0.314s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:31 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4f78c465-8bd8-4296-a605-1bf9bb35a584 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-e600e7d0-9d28-457b-891a-333d86b4355f" released by "_delete_snapshot" :: held 1.680s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:31 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4f78c465-8bd8-4296-a605-1bf9bb35a584 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-488c00fc-111e-429a-b4dd-5d9a3f55c53c" released by "delete_snapshot" :: held 1.708s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:31 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-4f78c465-8bd8-4296-a605-1bf9bb35a584 tempest-ProjectMemberTests-723363327 None] Created reservations ['55d85a34-6754-4a42-a207-f4fe7714dbab', 'aeb7a85b-9807-4902-ab3f-2b8b26008499', 'dbd1334a-5fc7-40e0-85ca-6c915c465b93', 'c246d176-cdb2-42bf-b5e9-6d8c821b35d8'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:26:31 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:31 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-d89be62e-1fcf-4be4-b78d-419d1baa9291 tempest-SnapshotDependencyTests-524816322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.341s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:31 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-d89be62e-1fcf-4be4-b78d-419d1baa9291 tempest-SnapshotDependencyTests-524816322 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:26:31 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-4f78c465-8bd8-4296-a605-1bf9bb35a584 tempest-ProjectMemberTests-723363327 None] Delete snapshot completed successfully. Jul 21 02:26:31 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-d89be62e-1fcf-4be4-b78d-419d1baa9291 tempest-SnapshotDependencyTests-524816322 None] Deleted volume successfully. Jul 21 02:26:31 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-4f78c465-8bd8-4296-a605-1bf9bb35a584 tempest-ProjectMemberTests-723363327 None] Lock "cinder-e600e7d0-9d28-457b-891a-333d86b4355f-delete_snapshot" released by "delete_snapshot" :: held 1.914s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:31 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-d89be62e-1fcf-4be4-b78d-419d1baa9291 tempest-SnapshotDependencyTests-524816322 None] Lock "cinder-8111a610-6039-4947-80d8-2965c1b30f08-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:32 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-35be22ba-bac3-43d3-9de0-ad973ab87173 tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-488c00fc-111e-429a-b4dd-5d9a3f55c53c-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:32 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-35be22ba-bac3-43d3-9de0-ad973ab87173 tempest-ProjectMemberTests-723363327 None] Lock "cinder-488c00fc-111e-429a-b4dd-5d9a3f55c53c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:32 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-35be22ba-bac3-43d3-9de0-ad973ab87173 tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-quobyte-488c00fc-111e-429a-b4dd-5d9a3f55c53c" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:32 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-35be22ba-bac3-43d3-9de0-ad973ab87173 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-488c00fc-111e-429a-b4dd-5d9a3f55c53c" acquired by "delete_volume" :: waited 0.019s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:32 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b1f206-327f-47d7-8662-0983e82d93aa]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-35be22ba-bac3-43d3-9de0-ad973ab87173 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:32 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c Jul 21 02:26:32 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:32 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-35be22ba-bac3-43d3-9de0-ad973ab87173 tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c" returned: 0 in 0.430s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-35be22ba-bac3-43d3-9de0-ad973ab87173 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:32 devstack sudo[108122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c Jul 21 02:26:32 devstack sudo[108122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:32 devstack sudo[108122]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:32 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-35be22ba-bac3-43d3-9de0-ad973ab87173 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-488c00fc-111e-429a-b4dd-5d9a3f55c53c" returned: 0 in 0.277s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:32 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-35be22ba-bac3-43d3-9de0-ad973ab87173 tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-488c00fc-111e-429a-b4dd-5d9a3f55c53c" released by "delete_volume" :: held 0.789s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:33 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-35be22ba-bac3-43d3-9de0-ad973ab87173 tempest-ProjectMemberTests-723363327 None] Created reservations ['4a2401db-6519-49f7-b9cf-8f5dfdb06dee', '6f187f3c-298d-4fac-aaa3-04767aafc69b', '956d81ff-abaa-441d-a469-e6644a75a173', '40126ca4-64b5-45f9-9e52-001142dace15'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:26:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-35be22ba-bac3-43d3-9de0-ad973ab87173 tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-35be22ba-bac3-43d3-9de0-ad973ab87173 tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:33 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-35be22ba-bac3-43d3-9de0-ad973ab87173 tempest-ProjectMemberTests-723363327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:26:33 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-35be22ba-bac3-43d3-9de0-ad973ab87173 tempest-ProjectMemberTests-723363327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:26:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-35be22ba-bac3-43d3-9de0-ad973ab87173 tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-35be22ba-bac3-43d3-9de0-ad973ab87173 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:33 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:26:33 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:33 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-35be22ba-bac3-43d3-9de0-ad973ab87173 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.360s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:33 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-35be22ba-bac3-43d3-9de0-ad973ab87173 tempest-ProjectMemberTests-723363327 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:26:33 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-35be22ba-bac3-43d3-9de0-ad973ab87173 tempest-ProjectMemberTests-723363327 None] Deleted volume successfully. Jul 21 02:26:33 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-35be22ba-bac3-43d3-9de0-ad973ab87173 tempest-ProjectMemberTests-723363327 None] Lock "cinder-488c00fc-111e-429a-b4dd-5d9a3f55c53c-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:33 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:26:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] Flow 'volume_create_manager' (abe02859-37c9-460e-88d2-dc760074b5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:26:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483ac015-ed56-4e64-b5d1-994a0ad3ddb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483ac015-ed56-4e64-b5d1-994a0ad3ddb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1412742799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dd3ee6b-c902-4937-9577-d6948d1ddd20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9180fe803c342ad96c373b69434c36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:26:34Z,use_quota=True,user_id='33a1095c5e17461e8e8a710d76a95247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58eb76d5-9a19-4145-a856-c9e363b7ead6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58eb76d5-9a19-4145-a856-c9e363b7ead6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be716d5d-09b0-439f-80ba-15c176034a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be716d5d-09b0-439f-80ba-15c176034a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dd3ee6b-c902-4937-9577-d6948d1ddd20', 'volume_name': 'volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a6b7ed8-debf-4921-8e12-c99fe3154124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a6b7ed8-debf-4921-8e12-c99fe3154124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:33 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0892a74-92d6-4116-bbdf-875f991f18ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:33 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] Volume 0dd3ee6b-c902-4937-9577-d6948d1ddd20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20', 'volume_size': 1} Jul 21 02:26:33 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1412742799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dd3ee6b-c902-4937-9577-d6948d1ddd20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9180fe803c342ad96c373b69434c36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:26:34Z,use_quota=True,user_id='33a1095c5e17461e8e8a710d76a95247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:26:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] Creating volume 0dd3ee6b-c902-4937-9577-d6948d1ddd20 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:26:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:26:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:26:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:26:34 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:26:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:34 devstack sudo[108130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20 1073741824 Jul 21 02:26:34 devstack sudo[108130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:34 devstack sudo[108130]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20 1073741824" returned: 0 in 0.514s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:34 devstack sudo[108136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20 Jul 21 02:26:34 devstack sudo[108136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:34 devstack sudo[108136]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20" returned: 0 in 0.367s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:34 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:26:34 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0892a74-92d6-4116-bbdf-875f991f18ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (577ed8b3-122e-4e53-ae4a-80253728d1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:34 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] Volume volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20 (0dd3ee6b-c902-4937-9577-d6948d1ddd20): created successfully Jul 21 02:26:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (577ed8b3-122e-4e53-ae4a-80253728d1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:34 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] Flow 'volume_create_manager' (abe02859-37c9-460e-88d2-dc760074b5aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:26:34 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-7e114472-5d30-4b93-86ac-62481e17b739 tempest-ProjectMemberTests-723363327 None] Created volume successfully. Jul 21 02:26:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2cb1bbe9-6af4-4edf-a1db-927426774cde tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2cb1bbe9-6af4-4edf-a1db-927426774cde tempest-ProjectMemberTests-723363327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:36 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-2cb1bbe9-6af4-4edf-a1db-927426774cde tempest-ProjectMemberTests-723363327 None] Creating offline snapshot 367fac0f-1cfc-41b3-b259-f1748d6e588b of volume 0dd3ee6b-c902-4937-9577-d6948d1ddd20 {{(pid=87566) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 02:26:36 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb51d2e8-f366-48b5-b598-d2ba90d1e7bb]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2cb1bbe9-6af4-4edf-a1db-927426774cde tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:36 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20 Jul 21 02:26:36 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:36 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2cb1bbe9-6af4-4edf-a1db-927426774cde tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20" returned: 0 in 0.461s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:36 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2cb1bbe9-6af4-4edf-a1db-927426774cde tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20.367fac0f-1cfc-41b3-b259-f1748d6e588b 1G {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:36 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20.367fac0f-1cfc-41b3-b259-f1748d6e588b 1G Jul 21 02:26:36 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:37 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2cb1bbe9-6af4-4edf-a1db-927426774cde tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20.367fac0f-1cfc-41b3-b259-f1748d6e588b 1G" returned: 0 in 0.428s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2cb1bbe9-6af4-4edf-a1db-927426774cde tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20.367fac0f-1cfc-41b3-b259-f1748d6e588b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:37 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20.367fac0f-1cfc-41b3-b259-f1748d6e588b Jul 21 02:26:37 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:37 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2cb1bbe9-6af4-4edf-a1db-927426774cde tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20 -F qcow2 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20.367fac0f-1cfc-41b3-b259-f1748d6e588b" returned: 0 in 0.342s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:37 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-2cb1bbe9-6af4-4edf-a1db-927426774cde tempest-ProjectMemberTests-723363327 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20.367fac0f-1cfc-41b3-b259-f1748d6e588b is being set with open permissions: ugo+rw Jul 21 02:26:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2cb1bbe9-6af4-4edf-a1db-927426774cde tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20.367fac0f-1cfc-41b3-b259-f1748d6e588b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:37 devstack sudo[108157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20.367fac0f-1cfc-41b3-b259-f1748d6e588b Jul 21 02:26:37 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:37 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2cb1bbe9-6af4-4edf-a1db-927426774cde tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20.367fac0f-1cfc-41b3-b259-f1748d6e588b" returned: 0 in 0.270s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:37 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2cb1bbe9-6af4-4edf-a1db-927426774cde tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:37 devstack sudo[108160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20.info Jul 21 02:26:37 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:38 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2cb1bbe9-6af4-4edf-a1db-927426774cde tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20.info" returned: 0 in 0.271s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:38 devstack cinder-volume[87566]: WARNING cinder.volume.drivers.remotefs [None req-2cb1bbe9-6af4-4edf-a1db-927426774cde tempest-ProjectMemberTests-723363327 None] /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20.info is being set with open permissions: ugo+rw Jul 21 02:26:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2cb1bbe9-6af4-4edf-a1db-927426774cde tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20.info {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:38 devstack sudo[108163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20.info Jul 21 02:26:38 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:38 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2cb1bbe9-6af4-4edf-a1db-927426774cde tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20.info" returned: 0 in 0.278s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:38 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2cb1bbe9-6af4-4edf-a1db-927426774cde tempest-ProjectMemberTests-723363327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.153s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:38 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-2cb1bbe9-6af4-4edf-a1db-927426774cde tempest-ProjectMemberTests-723363327 None] Create snapshot completed successfully Jul 21 02:26:39 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8a5c56d7-d42b-42df-8f8f-671e29039eeb tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-367fac0f-1cfc-41b3-b259-f1748d6e588b-delete_snapshot" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:39 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8a5c56d7-d42b-42df-8f8f-671e29039eeb tempest-ProjectMemberTests-723363327 None] Lock "cinder-367fac0f-1cfc-41b3-b259-f1748d6e588b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:39 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8a5c56d7-d42b-42df-8f8f-671e29039eeb tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-quobyte-0dd3ee6b-c902-4937-9577-d6948d1ddd20" by "delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:39 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8a5c56d7-d42b-42df-8f8f-671e29039eeb tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-0dd3ee6b-c902-4937-9577-d6948d1ddd20" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:39 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8a5c56d7-d42b-42df-8f8f-671e29039eeb tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-quobyte-367fac0f-1cfc-41b3-b259-f1748d6e588b" by "_delete_snapshot" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:39 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8a5c56d7-d42b-42df-8f8f-671e29039eeb tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-367fac0f-1cfc-41b3-b259-f1748d6e588b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-8a5c56d7-d42b-42df-8f8f-671e29039eeb tempest-ProjectMemberTests-723363327 None] Deleting offline snapshot 367fac0f-1cfc-41b3-b259-f1748d6e588b of volume 0dd3ee6b-c902-4937-9577-d6948d1ddd20 {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 02:26:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-8a5c56d7-d42b-42df-8f8f-671e29039eeb tempest-ProjectMemberTests-723363327 None] snapshot_file for this snap is: volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20.367fac0f-1cfc-41b3-b259-f1748d6e588b {{(pid=87566) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 02:26:39 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a119f4d-9832-4fa5-9a0d-ed805c3a4504]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8a5c56d7-d42b-42df-8f8f-671e29039eeb tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20.367fac0f-1cfc-41b3-b259-f1748d6e588b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:39 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20.367fac0f-1cfc-41b3-b259-f1748d6e588b Jul 21 02:26:39 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:39 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:39 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8a5c56d7-d42b-42df-8f8f-671e29039eeb tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20.367fac0f-1cfc-41b3-b259-f1748d6e588b" returned: 0 in 0.416s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:39 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-8a5c56d7-d42b-42df-8f8f-671e29039eeb tempest-ProjectMemberTests-723363327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87566) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 02:26:40 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af67e3b-4646-4d5d-ae99-d0de2dab191c]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8a5c56d7-d42b-42df-8f8f-671e29039eeb tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:40 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20 Jul 21 02:26:40 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:40 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8a5c56d7-d42b-42df-8f8f-671e29039eeb tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20" returned: 0 in 0.379s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8a5c56d7-d42b-42df-8f8f-671e29039eeb tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20.367fac0f-1cfc-41b3-b259-f1748d6e588b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:40 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20.367fac0f-1cfc-41b3-b259-f1748d6e588b Jul 21 02:26:40 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:40 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8a5c56d7-d42b-42df-8f8f-671e29039eeb tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20.367fac0f-1cfc-41b3-b259-f1748d6e588b" returned: 0 in 0.420s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:40 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8a5c56d7-d42b-42df-8f8f-671e29039eeb tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20.367fac0f-1cfc-41b3-b259-f1748d6e588b {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:40 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20.367fac0f-1cfc-41b3-b259-f1748d6e588b Jul 21 02:26:40 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:41 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8a5c56d7-d42b-42df-8f8f-671e29039eeb tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20.367fac0f-1cfc-41b3-b259-f1748d6e588b" returned: 0 in 0.305s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:41 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8a5c56d7-d42b-42df-8f8f-671e29039eeb tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-367fac0f-1cfc-41b3-b259-f1748d6e588b" released by "_delete_snapshot" :: held 1.646s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:41 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8a5c56d7-d42b-42df-8f8f-671e29039eeb tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-0dd3ee6b-c902-4937-9577-d6948d1ddd20" released by "delete_snapshot" :: held 1.678s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:41 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-8a5c56d7-d42b-42df-8f8f-671e29039eeb tempest-ProjectMemberTests-723363327 None] Created reservations ['01be785f-7fbf-4858-9bcf-a5584827623d', '449db592-5d5e-40e8-95a1-2fe9689a22a3', '26e81e2d-f2a4-4c4a-ab09-cf3b1b71210e', '00949b0e-d827-4a4d-b26c-b32e8c730bf2'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:26:41 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-8a5c56d7-d42b-42df-8f8f-671e29039eeb tempest-ProjectMemberTests-723363327 None] Delete snapshot completed successfully. Jul 21 02:26:41 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8a5c56d7-d42b-42df-8f8f-671e29039eeb tempest-ProjectMemberTests-723363327 None] Lock "cinder-367fac0f-1cfc-41b3-b259-f1748d6e588b-delete_snapshot" released by "delete_snapshot" :: held 1.861s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:41 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-52ac7b82-f1aa-4780-b678-8659a05d0d4f tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-0dd3ee6b-c902-4937-9577-d6948d1ddd20-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:41 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-52ac7b82-f1aa-4780-b678-8659a05d0d4f tempest-ProjectMemberTests-723363327 None] Lock "cinder-0dd3ee6b-c902-4937-9577-d6948d1ddd20-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:41 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-52ac7b82-f1aa-4780-b678-8659a05d0d4f tempest-ProjectMemberTests-723363327 None] Acquiring lock "cinder-quobyte-0dd3ee6b-c902-4937-9577-d6948d1ddd20" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:41 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-52ac7b82-f1aa-4780-b678-8659a05d0d4f tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-0dd3ee6b-c902-4937-9577-d6948d1ddd20" acquired by "delete_volume" :: waited 0.019s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:41 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44ec7ab-5bc7-4d1f-93b8-54239c92737e]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:41 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-52ac7b82-f1aa-4780-b678-8659a05d0d4f tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:41 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20 Jul 21 02:26:41 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:42 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-52ac7b82-f1aa-4780-b678-8659a05d0d4f tempest-ProjectMemberTests-723363327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20" returned: 0 in 0.347s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-52ac7b82-f1aa-4780-b678-8659a05d0d4f tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:42 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20 Jul 21 02:26:42 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:42 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-52ac7b82-f1aa-4780-b678-8659a05d0d4f tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-0dd3ee6b-c902-4937-9577-d6948d1ddd20" returned: 0 in 0.240s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:42 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-52ac7b82-f1aa-4780-b678-8659a05d0d4f tempest-ProjectMemberTests-723363327 None] Lock "cinder-quobyte-0dd3ee6b-c902-4937-9577-d6948d1ddd20" released by "delete_volume" :: held 0.651s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:42 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-52ac7b82-f1aa-4780-b678-8659a05d0d4f tempest-ProjectMemberTests-723363327 None] Created reservations ['46969e6a-fef9-4761-863d-1ed18f327e6f', 'e43c404e-165e-4cdb-888b-ad43b0a3732d', 'd6424b1e-76b0-4921-bc97-f1a215caba61', 'b328638f-d4b6-4638-8260-f51844d939ee'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:26:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-52ac7b82-f1aa-4780-b678-8659a05d0d4f tempest-ProjectMemberTests-723363327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-52ac7b82-f1aa-4780-b678-8659a05d0d4f tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:42 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-52ac7b82-f1aa-4780-b678-8659a05d0d4f tempest-ProjectMemberTests-723363327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:26:42 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-52ac7b82-f1aa-4780-b678-8659a05d0d4f tempest-ProjectMemberTests-723363327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:26:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-52ac7b82-f1aa-4780-b678-8659a05d0d4f tempest-ProjectMemberTests-723363327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-52ac7b82-f1aa-4780-b678-8659a05d0d4f tempest-ProjectMemberTests-723363327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:42 devstack sudo[108193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:26:42 devstack sudo[108193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:42 devstack sudo[108193]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:42 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-52ac7b82-f1aa-4780-b678-8659a05d0d4f tempest-ProjectMemberTests-723363327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.245s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:42 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-52ac7b82-f1aa-4780-b678-8659a05d0d4f tempest-ProjectMemberTests-723363327 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:26:42 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-52ac7b82-f1aa-4780-b678-8659a05d0d4f tempest-ProjectMemberTests-723363327 None] Deleted volume successfully. Jul 21 02:26:42 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-52ac7b82-f1aa-4780-b678-8659a05d0d4f tempest-ProjectMemberTests-723363327 None] Lock "cinder-0dd3ee6b-c902-4937-9577-d6948d1ddd20-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:46 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:26:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] Flow 'volume_create_manager' (c0662840-d546-4bca-a306-c917d3147fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:26:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5444dae-ead9-47d1-8b40-57c4533a9bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5444dae-ead9-47d1-8b40-57c4533a9bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-893393072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2488d994-5c17-4e5d-9d13-25314b94d20a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88860292ae614575bf01a0dfc1b21da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:26:46Z,use_quota=True,user_id='77283ec9aabf447ab0dd23cb448afc11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (248fa3c6-9427-4b6d-9a07-b01da1fe017f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (248fa3c6-9427-4b6d-9a07-b01da1fe017f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (298c22c3-e291-43b5-b8cb-2584ba0d3446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (298c22c3-e291-43b5-b8cb-2584ba0d3446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2488d994-5c17-4e5d-9d13-25314b94d20a', 'volume_name': 'volume-2488d994-5c17-4e5d-9d13-25314b94d20a', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce3b7466-81d3-4783-b22f-cfd59cd0bd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce3b7466-81d3-4783-b22f-cfd59cd0bd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (145f920a-626e-46b9-9c38-8e15d5a7f2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:46 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] Volume 2488d994-5c17-4e5d-9d13-25314b94d20a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2488d994-5c17-4e5d-9d13-25314b94d20a', 'volume_size': 1} Jul 21 02:26:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-893393072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2488d994-5c17-4e5d-9d13-25314b94d20a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88860292ae614575bf01a0dfc1b21da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:26:46Z,use_quota=True,user_id='77283ec9aabf447ab0dd23cb448afc11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:26:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] Creating volume 2488d994-5c17-4e5d-9d13-25314b94d20a {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:26:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:26:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:26:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:26:46 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:26:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2488d994-5c17-4e5d-9d13-25314b94d20a 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:46 devstack sudo[108197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2488d994-5c17-4e5d-9d13-25314b94d20a 1073741824 Jul 21 02:26:46 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:46 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2488d994-5c17-4e5d-9d13-25314b94d20a 1073741824" returned: 0 in 0.407s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2488d994-5c17-4e5d-9d13-25314b94d20a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:46 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2488d994-5c17-4e5d-9d13-25314b94d20a Jul 21 02:26:46 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:46 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2488d994-5c17-4e5d-9d13-25314b94d20a" returned: 0 in 0.243s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:46 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:26:46 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (145f920a-626e-46b9-9c38-8e15d5a7f2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2488d994-5c17-4e5d-9d13-25314b94d20a', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82323efe-449d-4f98-8ea3-49b2fc7c4b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:46 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] Volume volume-2488d994-5c17-4e5d-9d13-25314b94d20a (2488d994-5c17-4e5d-9d13-25314b94d20a): created successfully Jul 21 02:26:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82323efe-449d-4f98-8ea3-49b2fc7c4b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:46 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] Flow 'volume_create_manager' (c0662840-d546-4bca-a306-c917d3147fae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:26:46 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-9b9663c3-b68b-4767-86fe-674713ce2001 tempest-ProjectReaderTests-795178325 None] Created volume successfully. Jul 21 02:26:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2092e38c-8762-4a84-8d6f-7c621d30b87c tempest-ProjectReaderTests-795178325 None] Acquiring lock "cinder-2488d994-5c17-4e5d-9d13-25314b94d20a-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2092e38c-8762-4a84-8d6f-7c621d30b87c tempest-ProjectReaderTests-795178325 None] Lock "cinder-2488d994-5c17-4e5d-9d13-25314b94d20a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2092e38c-8762-4a84-8d6f-7c621d30b87c tempest-ProjectReaderTests-795178325 None] Acquiring lock "cinder-quobyte-2488d994-5c17-4e5d-9d13-25314b94d20a" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:47 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2092e38c-8762-4a84-8d6f-7c621d30b87c tempest-ProjectReaderTests-795178325 None] Lock "cinder-quobyte-2488d994-5c17-4e5d-9d13-25314b94d20a" acquired by "delete_volume" :: waited 0.015s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:47 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be6494e-0ee3-4076-8abf-0b5e29531a48]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2092e38c-8762-4a84-8d6f-7c621d30b87c tempest-ProjectReaderTests-795178325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2488d994-5c17-4e5d-9d13-25314b94d20a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:47 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2488d994-5c17-4e5d-9d13-25314b94d20a Jul 21 02:26:47 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:47 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2092e38c-8762-4a84-8d6f-7c621d30b87c tempest-ProjectReaderTests-795178325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2488d994-5c17-4e5d-9d13-25314b94d20a" returned: 0 in 0.348s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2092e38c-8762-4a84-8d6f-7c621d30b87c tempest-ProjectReaderTests-795178325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2488d994-5c17-4e5d-9d13-25314b94d20a {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:47 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2488d994-5c17-4e5d-9d13-25314b94d20a Jul 21 02:26:47 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:47 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:47 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2092e38c-8762-4a84-8d6f-7c621d30b87c tempest-ProjectReaderTests-795178325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-2488d994-5c17-4e5d-9d13-25314b94d20a" returned: 0 in 0.242s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2092e38c-8762-4a84-8d6f-7c621d30b87c tempest-ProjectReaderTests-795178325 None] Lock "cinder-quobyte-2488d994-5c17-4e5d-9d13-25314b94d20a" released by "delete_volume" :: held 0.624s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-2092e38c-8762-4a84-8d6f-7c621d30b87c tempest-ProjectReaderTests-795178325 None] Created reservations ['41b0b453-07e8-4744-b3b6-a72eeb4c7fe4', '7c147783-a788-4699-84df-e1136dabd60f', 'b58f09f4-53b1-4a47-bfcb-0d829220a30c', 'dbd45df0-734b-4684-9dce-b166900328e8'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2092e38c-8762-4a84-8d6f-7c621d30b87c tempest-ProjectReaderTests-795178325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2092e38c-8762-4a84-8d6f-7c621d30b87c tempest-ProjectReaderTests-795178325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2092e38c-8762-4a84-8d6f-7c621d30b87c tempest-ProjectReaderTests-795178325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-2092e38c-8762-4a84-8d6f-7c621d30b87c tempest-ProjectReaderTests-795178325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-2092e38c-8762-4a84-8d6f-7c621d30b87c tempest-ProjectReaderTests-795178325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2092e38c-8762-4a84-8d6f-7c621d30b87c tempest-ProjectReaderTests-795178325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:48 devstack sudo[108214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:26:48 devstack sudo[108214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:48 devstack sudo[108214]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-2092e38c-8762-4a84-8d6f-7c621d30b87c tempest-ProjectReaderTests-795178325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.243s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-2092e38c-8762-4a84-8d6f-7c621d30b87c tempest-ProjectReaderTests-795178325 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:26:48 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-2092e38c-8762-4a84-8d6f-7c621d30b87c tempest-ProjectReaderTests-795178325 None] Deleted volume successfully. Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-2092e38c-8762-4a84-8d6f-7c621d30b87c tempest-ProjectReaderTests-795178325 None] Lock "cinder-2488d994-5c17-4e5d-9d13-25314b94d20a-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] Flow 'volume_create_manager' (c0050138-b63d-4948-b21e-371a2c03bacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0cbfdff-bfa7-4f83-ba3d-9b94a0023636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0cbfdff-bfa7-4f83-ba3d-9b94a0023636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1858804616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=408155d2-ba47-4755-8590-1dc1b3d5d721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88860292ae614575bf01a0dfc1b21da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:26:49Z,use_quota=True,user_id='77283ec9aabf447ab0dd23cb448afc11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:48 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:26:48 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5ffe22e-3d4a-4e5c-b5de-51bdd920d1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5ffe22e-3d4a-4e5c-b5de-51bdd920d1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (288460f0-8a40-402f-98b3-565443f2a696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (288460f0-8a40-402f-98b3-565443f2a696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '408155d2-ba47-4755-8590-1dc1b3d5d721', 'volume_name': 'volume-408155d2-ba47-4755-8590-1dc1b3d5d721', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (807a9ae9-ee19-47be-a3c7-b5039d9160d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (807a9ae9-ee19-47be-a3c7-b5039d9160d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c90eb2c7-7708-4706-b998-452a9e353d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:48 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] Volume 408155d2-ba47-4755-8590-1dc1b3d5d721: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-408155d2-ba47-4755-8590-1dc1b3d5d721', 'volume_size': 1} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1858804616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=408155d2-ba47-4755-8590-1dc1b3d5d721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88860292ae614575bf01a0dfc1b21da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:26:49Z,use_quota=True,user_id='77283ec9aabf447ab0dd23cb448afc11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] Creating volume 408155d2-ba47-4755-8590-1dc1b3d5d721 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:26:48 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:26:48 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-408155d2-ba47-4755-8590-1dc1b3d5d721 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:48 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-408155d2-ba47-4755-8590-1dc1b3d5d721 1073741824 Jul 21 02:26:48 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:49 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.245s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:49 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:26:49 devstack cinder-volume[87566]: DEBUG oslo_service.periodic_task [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] Running periodic task VolumeManager._thread_info {{(pid=87566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 02:26:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread count: 28 {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 02:26:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-dd852ab3-1617-4fe5-a72c-81e667e03293 None None] thread info: [<_MainThread(MainThread, started 135786703114368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 02:26:49 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-408155d2-ba47-4755-8590-1dc1b3d5d721 1073741824" returned: 0 in 0.390s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-408155d2-ba47-4755-8590-1dc1b3d5d721 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:49 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-408155d2-ba47-4755-8590-1dc1b3d5d721 Jul 21 02:26:49 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:49 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-408155d2-ba47-4755-8590-1dc1b3d5d721" returned: 0 in 0.241s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:49 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] <== create_volume: return (668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:26:49 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.671s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c90eb2c7-7708-4706-b998-452a9e353d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-408155d2-ba47-4755-8590-1dc1b3d5d721', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d99c475c-2a1c-479b-b3fb-836922703eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:49 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] Volume volume-408155d2-ba47-4755-8590-1dc1b3d5d721 (408155d2-ba47-4755-8590-1dc1b3d5d721): created successfully Jul 21 02:26:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d99c475c-2a1c-479b-b3fb-836922703eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:49 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] Flow 'volume_create_manager' (c0050138-b63d-4948-b21e-371a2c03bacc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:26:49 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-88e949a3-85d6-49fe-b250-c985a1f4fc98 tempest-ProjectReaderTests-795178325 None] Created volume successfully. Jul 21 02:26:49 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8d27e157-7378-4c3e-9267-141d3cc2a163 tempest-ProjectReaderTests-795178325 None] Acquiring lock "cinder-408155d2-ba47-4755-8590-1dc1b3d5d721-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:49 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8d27e157-7378-4c3e-9267-141d3cc2a163 tempest-ProjectReaderTests-795178325 None] Lock "cinder-408155d2-ba47-4755-8590-1dc1b3d5d721-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:49 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8d27e157-7378-4c3e-9267-141d3cc2a163 tempest-ProjectReaderTests-795178325 None] Acquiring lock "cinder-quobyte-408155d2-ba47-4755-8590-1dc1b3d5d721" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:49 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8d27e157-7378-4c3e-9267-141d3cc2a163 tempest-ProjectReaderTests-795178325 None] Lock "cinder-quobyte-408155d2-ba47-4755-8590-1dc1b3d5d721" acquired by "delete_volume" :: waited 0.013s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:50 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7b2759-bb10-4542-9675-461549ba3d5a]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8d27e157-7378-4c3e-9267-141d3cc2a163 tempest-ProjectReaderTests-795178325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-408155d2-ba47-4755-8590-1dc1b3d5d721 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:50 devstack sudo[108229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-408155d2-ba47-4755-8590-1dc1b3d5d721 Jul 21 02:26:50 devstack sudo[108229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:50 devstack sudo[108229]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8d27e157-7378-4c3e-9267-141d3cc2a163 tempest-ProjectReaderTests-795178325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-408155d2-ba47-4755-8590-1dc1b3d5d721" returned: 0 in 0.345s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8d27e157-7378-4c3e-9267-141d3cc2a163 tempest-ProjectReaderTests-795178325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-408155d2-ba47-4755-8590-1dc1b3d5d721 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:50 devstack sudo[108234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-408155d2-ba47-4755-8590-1dc1b3d5d721 Jul 21 02:26:50 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:50 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8d27e157-7378-4c3e-9267-141d3cc2a163 tempest-ProjectReaderTests-795178325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-408155d2-ba47-4755-8590-1dc1b3d5d721" returned: 0 in 0.252s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8d27e157-7378-4c3e-9267-141d3cc2a163 tempest-ProjectReaderTests-795178325 None] Lock "cinder-quobyte-408155d2-ba47-4755-8590-1dc1b3d5d721" released by "delete_volume" :: held 0.630s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:50 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-8d27e157-7378-4c3e-9267-141d3cc2a163 tempest-ProjectReaderTests-795178325 None] Created reservations ['f8f49e35-ef05-4db0-a6ff-bed8e6e60f62', '785b6487-fff7-4a89-8479-bf3a0024134c', '7e688c35-8e28-4ebc-bf38-e4a8b1bf8bc3', 'd9107bc9-5c24-49cc-9dfa-b3e48000264b'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:26:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8d27e157-7378-4c3e-9267-141d3cc2a163 tempest-ProjectReaderTests-795178325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8d27e157-7378-4c3e-9267-141d3cc2a163 tempest-ProjectReaderTests-795178325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8d27e157-7378-4c3e-9267-141d3cc2a163 tempest-ProjectReaderTests-795178325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:26:50 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8d27e157-7378-4c3e-9267-141d3cc2a163 tempest-ProjectReaderTests-795178325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:26:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8d27e157-7378-4c3e-9267-141d3cc2a163 tempest-ProjectReaderTests-795178325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8d27e157-7378-4c3e-9267-141d3cc2a163 tempest-ProjectReaderTests-795178325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:50 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:26:50 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:50 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:50 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8d27e157-7378-4c3e-9267-141d3cc2a163 tempest-ProjectReaderTests-795178325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.237s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:50 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-8d27e157-7378-4c3e-9267-141d3cc2a163 tempest-ProjectReaderTests-795178325 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:26:50 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-8d27e157-7378-4c3e-9267-141d3cc2a163 tempest-ProjectReaderTests-795178325 None] Deleted volume successfully. Jul 21 02:26:50 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-8d27e157-7378-4c3e-9267-141d3cc2a163 tempest-ProjectReaderTests-795178325 None] Lock "cinder-408155d2-ba47-4755-8590-1dc1b3d5d721-delete_volume" released by "delete_volume" :: held 1.044s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:51 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:26:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] Flow 'volume_create_manager' (352fbb3f-9ebf-4982-8a9e-7a732665a811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:26:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c65ffefb-59c8-4ff5-8742-45842cbac7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c65ffefb-59c8-4ff5-8742-45842cbac7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1047345138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29423408-53f7-4afe-8a12-754ec05c739d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88860292ae614575bf01a0dfc1b21da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:26:51Z,use_quota=True,user_id='77283ec9aabf447ab0dd23cb448afc11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfab8aec-5b45-4b86-962b-7d1f633bf880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfab8aec-5b45-4b86-962b-7d1f633bf880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff797f9d-7bf7-4a59-9e4c-138148d866a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff797f9d-7bf7-4a59-9e4c-138148d866a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29423408-53f7-4afe-8a12-754ec05c739d', 'volume_name': 'volume-29423408-53f7-4afe-8a12-754ec05c739d', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09f7e2c7-6894-4756-b608-f07102d407e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09f7e2c7-6894-4756-b608-f07102d407e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:51 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f96c36e9-28a4-4233-9038-993714fd62e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:51 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] Volume 29423408-53f7-4afe-8a12-754ec05c739d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29423408-53f7-4afe-8a12-754ec05c739d', 'volume_size': 1} Jul 21 02:26:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:51 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1047345138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29423408-53f7-4afe-8a12-754ec05c739d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88860292ae614575bf01a0dfc1b21da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:26:51Z,use_quota=True,user_id='77283ec9aabf447ab0dd23cb448afc11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:26:51 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] Creating volume 29423408-53f7-4afe-8a12-754ec05c739d {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:26:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:51 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:26:51 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:26:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:51 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:26:51 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:26:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-29423408-53f7-4afe-8a12-754ec05c739d 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:51 devstack sudo[108242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-29423408-53f7-4afe-8a12-754ec05c739d 1073741824 Jul 21 02:26:51 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:51 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:51 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-29423408-53f7-4afe-8a12-754ec05c739d 1073741824" returned: 0 in 0.400s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-29423408-53f7-4afe-8a12-754ec05c739d {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:52 devstack sudo[108247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-29423408-53f7-4afe-8a12-754ec05c739d Jul 21 02:26:52 devstack sudo[108247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:52 devstack sudo[108247]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-29423408-53f7-4afe-8a12-754ec05c739d" returned: 0 in 0.235s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:52 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:26:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:52 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f96c36e9-28a4-4233-9038-993714fd62e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29423408-53f7-4afe-8a12-754ec05c739d', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:52 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc39c00a-7605-401f-8224-de73bb1b9e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:52 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] Volume volume-29423408-53f7-4afe-8a12-754ec05c739d (29423408-53f7-4afe-8a12-754ec05c739d): created successfully Jul 21 02:26:52 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc39c00a-7605-401f-8224-de73bb1b9e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:52 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] Flow 'volume_create_manager' (352fbb3f-9ebf-4982-8a9e-7a732665a811) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:26:52 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-421a20e1-a147-4bd4-89d9-a8f4baf1ee0e tempest-ProjectReaderTests-795178325 None] Created volume successfully. Jul 21 02:26:52 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-30cafd48-c372-4182-b015-aa970f1225b7 tempest-ProjectReaderTests-795178325 None] Acquiring lock "cinder-29423408-53f7-4afe-8a12-754ec05c739d-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:52 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-30cafd48-c372-4182-b015-aa970f1225b7 tempest-ProjectReaderTests-795178325 None] Lock "cinder-29423408-53f7-4afe-8a12-754ec05c739d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:52 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-30cafd48-c372-4182-b015-aa970f1225b7 tempest-ProjectReaderTests-795178325 None] Acquiring lock "cinder-quobyte-29423408-53f7-4afe-8a12-754ec05c739d" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:52 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-30cafd48-c372-4182-b015-aa970f1225b7 tempest-ProjectReaderTests-795178325 None] Lock "cinder-quobyte-29423408-53f7-4afe-8a12-754ec05c739d" acquired by "delete_volume" :: waited 0.014s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:52 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a82df5-a0e2-4ebe-9f44-b68666687908]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-30cafd48-c372-4182-b015-aa970f1225b7 tempest-ProjectReaderTests-795178325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-29423408-53f7-4afe-8a12-754ec05c739d {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:52 devstack sudo[108250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-29423408-53f7-4afe-8a12-754ec05c739d Jul 21 02:26:52 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:52 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-30cafd48-c372-4182-b015-aa970f1225b7 tempest-ProjectReaderTests-795178325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-29423408-53f7-4afe-8a12-754ec05c739d" returned: 0 in 0.348s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:52 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-30cafd48-c372-4182-b015-aa970f1225b7 tempest-ProjectReaderTests-795178325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-29423408-53f7-4afe-8a12-754ec05c739d {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:53 devstack sudo[108256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-29423408-53f7-4afe-8a12-754ec05c739d Jul 21 02:26:53 devstack sudo[108256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:53 devstack sudo[108256]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-30cafd48-c372-4182-b015-aa970f1225b7 tempest-ProjectReaderTests-795178325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-29423408-53f7-4afe-8a12-754ec05c739d" returned: 0 in 0.235s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:53 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-30cafd48-c372-4182-b015-aa970f1225b7 tempest-ProjectReaderTests-795178325 None] Lock "cinder-quobyte-29423408-53f7-4afe-8a12-754ec05c739d" released by "delete_volume" :: held 0.619s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:53 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-30cafd48-c372-4182-b015-aa970f1225b7 tempest-ProjectReaderTests-795178325 None] Created reservations ['2cac8d17-5b16-4211-9120-e852bfe0c7c2', '9bcfee13-ee0d-4509-bf70-db0b98c87e57', 'e9b097c7-00af-45d6-a452-ced316927e0d', '1756d72f-2db7-46b1-a7fa-2983d3761250'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:26:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-30cafd48-c372-4182-b015-aa970f1225b7 tempest-ProjectReaderTests-795178325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-30cafd48-c372-4182-b015-aa970f1225b7 tempest-ProjectReaderTests-795178325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-30cafd48-c372-4182-b015-aa970f1225b7 tempest-ProjectReaderTests-795178325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:26:53 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-30cafd48-c372-4182-b015-aa970f1225b7 tempest-ProjectReaderTests-795178325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:26:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-30cafd48-c372-4182-b015-aa970f1225b7 tempest-ProjectReaderTests-795178325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-30cafd48-c372-4182-b015-aa970f1225b7 tempest-ProjectReaderTests-795178325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:53 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:26:53 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:53 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:53 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-30cafd48-c372-4182-b015-aa970f1225b7 tempest-ProjectReaderTests-795178325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.236s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:53 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-30cafd48-c372-4182-b015-aa970f1225b7 tempest-ProjectReaderTests-795178325 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:26:53 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-30cafd48-c372-4182-b015-aa970f1225b7 tempest-ProjectReaderTests-795178325 None] Deleted volume successfully. Jul 21 02:26:53 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-30cafd48-c372-4182-b015-aa970f1225b7 tempest-ProjectReaderTests-795178325 None] Lock "cinder-29423408-53f7-4afe-8a12-754ec05c739d-delete_volume" released by "delete_volume" :: held 1.030s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:54 devstack cinder-volume[87566]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87566) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 02:26:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] Flow 'volume_create_manager' (6c574a73-d57f-4fa0-a4bc-8252e22f04bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:26:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2805e12-1aa0-471a-b02d-8e49c3a17cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2805e12-1aa0-471a-b02d-8e49c3a17cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-119485007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cddabc0-9887-4e95-b0e8-c39d640f46a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88860292ae614575bf01a0dfc1b21da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:26:54Z,use_quota=True,user_id='77283ec9aabf447ab0dd23cb448afc11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd040be-5ab1-49d8-9d72-b0cad52cd458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd040be-5ab1-49d8-9d72-b0cad52cd458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4adf30da-ad22-4eb6-a484-ec54c9a22f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4adf30da-ad22-4eb6-a484-ec54c9a22f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cddabc0-9887-4e95-b0e8-c39d640f46a4', 'volume_name': 'volume-6cddabc0-9887-4e95-b0e8-c39d640f46a4', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13049e2c-586e-4f6e-bf49-a572db4c470c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13049e2c-586e-4f6e-bf49-a572db4c470c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4101ba47-8f3e-4514-8f56-795dfe4518a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:54 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] Volume 6cddabc0-9887-4e95-b0e8-c39d640f46a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cddabc0-9887-4e95-b0e8-c39d640f46a4', 'volume_size': 1} Jul 21 02:26:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:54 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T00:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-119485007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cddabc0-9887-4e95-b0e8-c39d640f46a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88860292ae614575bf01a0dfc1b21da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T00:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T00:26:54Z,use_quota=True,user_id='77283ec9aabf447ab0dd23cb448afc11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c84f85e-13c3-49c5-a537-4b15107a8845),volume_type_id=2c84f85e-13c3-49c5-a537-4b15107a8845)}" {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 02:26:54 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.remotefs [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] Creating volume 6cddabc0-9887-4e95-b0e8-c39d640f46a4 {{(pid=87566) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 02:26:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:54 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:26:54 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:26:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:54 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] Selected osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea as target Quobyte volume. {{(pid=87566) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 02:26:54 devstack cinder-volume[87566]: INFO cinder.volume.drivers.remotefs [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] casted to osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea Jul 21 02:26:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6cddabc0-9887-4e95-b0e8-c39d640f46a4 1073741824 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:54 devstack sudo[108262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6cddabc0-9887-4e95-b0e8-c39d640f46a4 1073741824 Jul 21 02:26:54 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:54 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6cddabc0-9887-4e95-b0e8-c39d640f46a4 1073741824" returned: 0 in 0.384s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6cddabc0-9887-4e95-b0e8-c39d640f46a4 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:54 devstack sudo[108268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6cddabc0-9887-4e95-b0e8-c39d640f46a4 Jul 21 02:26:54 devstack sudo[108268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:54 devstack sudo[108268]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6cddabc0-9887-4e95-b0e8-c39d640f46a4" returned: 0 in 0.236s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:54 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] <== create_volume: return (658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'} {{(pid=87566) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 02:26:54 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.660s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4101ba47-8f3e-4514-8f56-795dfe4518a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cddabc0-9887-4e95-b0e8-c39d640f46a4', 'volume_size': 1}' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aad667d3-3bfc-46ca-a519-c291a706281d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 02:26:54 devstack cinder-volume[87566]: INFO cinder.volume.flows.manager.create_volume [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] Volume volume-6cddabc0-9887-4e95-b0e8-c39d640f46a4 (6cddabc0-9887-4e95-b0e8-c39d640f46a4): created successfully Jul 21 02:26:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aad667d3-3bfc-46ca-a519-c291a706281d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87566) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 02:26:54 devstack cinder-volume[87566]: DEBUG cinder.volume.manager [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] Flow 'volume_create_manager' (6c574a73-d57f-4fa0-a4bc-8252e22f04bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87566) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 02:26:54 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-8b6856af-f707-4f8f-a1ae-a767afe07a78 tempest-ProjectReaderTests-795178325 None] Created volume successfully. Jul 21 02:26:55 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-df3e3964-9caf-4b27-a5a3-9ac95816525c tempest-ProjectReaderTests-795178325 None] Acquiring lock "cinder-6cddabc0-9887-4e95-b0e8-c39d640f46a4-delete_volume" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:55 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-df3e3964-9caf-4b27-a5a3-9ac95816525c tempest-ProjectReaderTests-795178325 None] Lock "cinder-6cddabc0-9887-4e95-b0e8-c39d640f46a4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:55 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-df3e3964-9caf-4b27-a5a3-9ac95816525c tempest-ProjectReaderTests-795178325 None] Acquiring lock "cinder-quobyte-6cddabc0-9887-4e95-b0e8-c39d640f46a4" by "delete_volume" {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 02:26:55 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-df3e3964-9caf-4b27-a5a3-9ac95816525c tempest-ProjectReaderTests-795178325 None] Lock "cinder-quobyte-6cddabc0-9887-4e95-b0e8-c39d640f46a4" acquired by "delete_volume" :: waited 0.013s {{(pid=87566) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 02:26:55 devstack cinder-volume[87566]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9595a4-6ca9-44fb-b1ee-311038eca4c7]: (4, 'qcow2') {{(pid=89104) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 02:26:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-df3e3964-9caf-4b27-a5a3-9ac95816525c tempest-ProjectReaderTests-795178325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6cddabc0-9887-4e95-b0e8-c39d640f46a4 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:55 devstack sudo[108271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6cddabc0-9887-4e95-b0e8-c39d640f46a4 Jul 21 02:26:55 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:55 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-df3e3964-9caf-4b27-a5a3-9ac95816525c tempest-ProjectReaderTests-795178325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6cddabc0-9887-4e95-b0e8-c39d640f46a4" returned: 0 in 0.337s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-df3e3964-9caf-4b27-a5a3-9ac95816525c tempest-ProjectReaderTests-795178325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6cddabc0-9887-4e95-b0e8-c39d640f46a4 {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:55 devstack sudo[108276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6cddabc0-9887-4e95-b0e8-c39d640f46a4 Jul 21 02:26:55 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:55 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-df3e3964-9caf-4b27-a5a3-9ac95816525c tempest-ProjectReaderTests-795178325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc/volume-6cddabc0-9887-4e95-b0e8-c39d640f46a4" returned: 0 in 0.239s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:55 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-df3e3964-9caf-4b27-a5a3-9ac95816525c tempest-ProjectReaderTests-795178325 None] Lock "cinder-quobyte-6cddabc0-9887-4e95-b0e8-c39d640f46a4" released by "delete_volume" :: held 0.609s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:26:55 devstack cinder-volume[87566]: DEBUG cinder.quota [None req-df3e3964-9caf-4b27-a5a3-9ac95816525c tempest-ProjectReaderTests-795178325 None] Created reservations ['f09a03d9-6d5d-409e-97f7-c0eeff42dcc6', 'd6e64864-0c91-463b-a76b-185fbfa88793', 'ba9427b9-e706-4618-b6eb-bb5e8e3a75aa', 'f13eb6c0-ead1-4548-a552-40d177e9067d'] {{(pid=87566) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 02:26:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-df3e3964-9caf-4b27-a5a3-9ac95816525c tempest-ProjectReaderTests-795178325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 02:26:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-df3e3964-9caf-4b27-a5a3-9ac95816525c tempest-ProjectReaderTests-795178325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 02:26:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-df3e3964-9caf-4b27-a5a3-9ac95816525c tempest-ProjectReaderTests-795178325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea': None} {{(pid=87566) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 02:26:55 devstack cinder-volume[87566]: DEBUG cinder.volume.drivers.quobyte [None req-df3e3964-9caf-4b27-a5a3-9ac95816525c tempest-ProjectReaderTests-795178325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0347442-e678-45de-a374-b63fae53a9ea'] {{(pid=87566) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 02:26:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.lockutils [None req-df3e3964-9caf-4b27-a5a3-9ac95816525c tempest-ProjectReaderTests-795178325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87566) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 02:26:55 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-df3e3964-9caf-4b27-a5a3-9ac95816525c tempest-ProjectReaderTests-795178325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 02:26:55 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc Jul 21 02:26:55 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 02:26:56 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Jul 21 02:26:56 devstack cinder-volume[87566]: DEBUG oslo_concurrency.processutils [None req-df3e3964-9caf-4b27-a5a3-9ac95816525c tempest-ProjectReaderTests-795178325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8502fa8b0ef18d4d6f686112180d58dc" returned: 0 in 0.238s {{(pid=87566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 02:26:56 devstack cinder-volume[87566]: DEBUG cinder.manager [None req-df3e3964-9caf-4b27-a5a3-9ac95816525c tempest-ProjectReaderTests-795178325 None] Notifying Schedulers of capabilities ... {{(pid=87566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 02:26:56 devstack cinder-volume[87566]: INFO cinder.volume.manager [None req-df3e3964-9caf-4b27-a5a3-9ac95816525c tempest-ProjectReaderTests-795178325 None] Deleted volume successfully. Jul 21 02:26:56 devstack cinder-volume[87566]: DEBUG cinder.coordination [None req-df3e3964-9caf-4b27-a5a3-9ac95816525c tempest-ProjectReaderTests-795178325 None] Lock "cinder-6cddabc0-9887-4e95-b0e8-c39d640f46a4-delete_volume" released by "delete_volume" :: held 1.019s {{(pid=87566) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 02:27:05 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:INSERT=26,cinder:SELECT=60,cinder:UPDATE=97,cinder:DELETE=7 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 02:27:06 devstack cinder-volume[87566]: DEBUG dbcounter [-] [87566] Writing DB stats cinder:SELECT=74,cinder:INSERT=24,cinder:UPDATE=98,cinder:DELETE=8 {{(pid=87566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}